Sep 11 13:41:16 devstack cinder-volume[77517]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 13:41:16 devstack cinder-volume[77517]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 13:41:16 devstack cinder-volume[77517]: we strongly recommend against using it for new projects. Sep 11 13:41:16 devstack cinder-volume[77517]: If you are already using Eventlet, we recommend migrating to a different Sep 11 13:41:16 devstack cinder-volume[77517]: framework. For more detail see Sep 11 13:41:16 devstack cinder-volume[77517]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 13:41:16 devstack cinder-volume[77517]: import eventlet # noqa Sep 11 13:41:19 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:41:19 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:41:19 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:41:20 devstack cinder-volume[77517]: INFO dbcounter [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Registered counter for database cinder Sep 11 13:41:20 devstack cinder-volume[77517]: DEBUG oslo_db.sqlalchemy.engines [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:41:21 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writer thread running {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 13:41:21 devstack cinder-volume[77517]: INFO cinder.rpc [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 13:41:21 devstack cinder-volume[77517]: INFO cinder.rpc [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 13:41:21 devstack cinder-volume[77517]: DEBUG oslo_db.sqlalchemy.engines [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:41:21 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Determined volume DB was empty at startup. Sep 11 13:41:21 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77517) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 13:41:21 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 13:41:21 devstack cinder-volume[77517]: WARNING stevedore.named [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 13:41:21 devstack cinder-volume[77517]: WARNING castellan.key_manager [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:41:21 devstack cinder-volume[77517]: WARNING cinder.keymgr.conf_key_mgr [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:41:21 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77517) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 11 13:41:21 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:21 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] CMD "cinder-rtstool verify" returned: 0 in 0.513s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_db.sqlalchemy.engines [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:41:22 devstack cinder-volume[77517]: INFO cinder.rpc [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 11 13:41:22 devstack cinder-volume[77517]: INFO cinder.rpc [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 11 13:41:22 devstack cinder-volume[77517]: WARNING stevedore.named [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 13:41:22 devstack cinder-volume[77517]: WARNING castellan.key_manager [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:41:22 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_db.sqlalchemy.engines [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:41:22 devstack cinder-volume[77517]: INFO oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Starting 1 workers Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Started child 77676 {{(pid=77517) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Full set of CONF: {{(pid=77517) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] ******************************************************************************** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Configuration options gathered from: {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] ================================================================================ {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] allow_availability_zone_fallback = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] allow_compression_on_image_upload = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] allowed_direct_url_schemes = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] api_rate_limit = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] auth_strategy = keystone {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] az_cache_duration = 3600 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_availability_zone = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77676]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_host = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_stats_polling_interval = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backup_api_class = cinder.backup.api.API {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backup_name_template = backup-%s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backup_use_same_host = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backup_use_temp_snapshot = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] chap_password = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] chap_username = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_internal_tenant_project_id = e6ea3cf2352441bf926cdac896a52bed {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_internal_tenant_user_id = 4b1e60ceaf904eb8b4fbee3949c25609 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cloned_volume_same_az = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cluster = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] compression_format = gzip {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] compute_api_class = cinder.compute.nova.API {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] config_dir = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] config_source = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] control_exchange = openstack {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] debug = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] default_availability_zone = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] default_group_type = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] default_volume_type = lvmdriver-1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] disk_geometry = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] driver_client_cert = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] driver_client_cert_key = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] driver_data_namespace = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] driver_ssl_cert_path = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] driver_ssl_cert_verify = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] driver_use_ssl = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] enable_force_upload = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] enable_new_services = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] enable_unsupported_driver = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] enabled_backends = ['lvmdriver-1'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] enforce_multipath_for_image_xfer = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] filter_function = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_api_insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_api_servers = ['http://192.168.122.63/image'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_api_ssl_compression = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_ca_certificates_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_catalog_info = image:glance:publicURL {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_num_retries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance_request_timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] goodness_function = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] graceful_shutdown_timeout = 5 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] group_api_class = cinder.group.api.API {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] host = devstack {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_compress_on_upload = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77676]: INFO cinder.volume.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_conversion_address_space_limit = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_conversion_cpu_limit = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_conversion_disable = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_upload_use_cinder_backend = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_upload_use_internal_tenant = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_volume_cache_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_volume_cache_max_count = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] image_volume_cache_max_size_gb = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] init_host_max_objects_retrieval = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] instance_format = [instance: %(uuid)s] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] iscsi_target_flags = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] iscsi_write_cache = on {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] iser_helper = tgtadm {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] iser_ip_address = 192.168.122.63 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] iser_port = 3260 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_color = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_config_append = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_dir = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_options = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_rotate_interval = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_rotate_interval_type = days {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] log_rotation_type = none {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] max_age = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] max_logfile_count = 30 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] max_logfile_size_mb = 200 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] max_over_subscription_ratio = 20.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] message_reap_interval = 86400 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] message_ttl = 2592000 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] migration_create_volume_timeout_secs = 300 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] monkey_patch = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] monkey_patch_modules = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] my_ip = 192.168.122.63 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] no_snapshot_gb_quota = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] num_iser_scan_tries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] num_shell_tries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] num_volume_device_scan_tries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] nvmeof_conn_info_version = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] nvmet_ns_id = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] nvmet_port_id = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_max_limit = 1000 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_volume_ext_list = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_volume_listen = 0.0.0.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_volume_listen_port = 8776 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_volume_use_ssl = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] osapi_volume_workers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] per_volume_size_limit = -1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] periodic_fuzzy_delay = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] periodic_interval = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] project_id_regex = [0-9a-f\-]+ {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] public_endpoint = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] publish_errors = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_backup_gigabytes = 1000 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_backups = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_gigabytes = 1000 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_groups = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_snapshots = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] quota_volumes = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] rate_limit_burst = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] rate_limit_except_level = CRITICAL {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] rate_limit_interval = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] reinit_driver_count = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] replication_device = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] report_discard_supported = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] report_interval = 120 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] reservation_clean_interval = 86400 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] reservation_expire = 86400 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] reserved_image_namespaces = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] reserved_percentage = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] rpc_response_timeout = 120 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] run_external_periodic_tasks = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] scst_target_driver = iscsi {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] scst_target_iqn_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_down_time = 720 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] shell_completion = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] snapshot_name_template = snapshot-%s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] snapshot_same_host = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] split_loggers = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] state_path = /opt/stack/data/cinder {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] storage_availability_zone = nova {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] storage_protocol = iSCSI {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] syslog_log_facility = LOG_USER {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] target_helper = lioadm {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] target_ip_address = 192.168.122.63 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] target_port = 3260 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] target_protocol = iscsi {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] target_secondary_ip_addresses = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] trace_flags = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] transfer_api_class = cinder.transfer.api.API {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] transport_url = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] until_refresh = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_chap_auth = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_default_quota_class = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_journal = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_json = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack sudo[77684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_multipath_for_image_xfer = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_stderr = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] use_syslog = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack sudo[77684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] verify_glance_signatures = enabled {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_api_class = cinder.volume.api.API {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_backend_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_clear = zero {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_clear_ionice = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_clear_size = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_copy_bps_limit = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_dd_blocksize = 1M {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_name_template = volume-%s {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_service_inithost_offload = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volume_usage_audit_period = month {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] zoning_mode = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_concurrency.disable_process_locking = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.auth_section = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.auth_type = password {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.auth_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.cache = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.delay_auth_decision = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.http_connect_timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.include_service_catalog = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.interface = public {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_password = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcache_username = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.region_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.service_token_roles_required = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.service_type = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.token_cache_time = 300 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.63/identity {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.backend = dogpile.cache.null {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.backend_argument = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.backend_expiration_time = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.config_prefix = cache.oslo {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.debug_cache_backend = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.enable_retry_client = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.enable_socket_keepalive = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.expiration_time = 600 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.hashclient_retry_attempts = 2 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_dead_retry = 300 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_pool_maxsize = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_sasl_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.password = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.proxies = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.redis_db = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.redis_sentinel_service_name = mymaster {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.redis_server = localhost:6379 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.retry_attempts = 2 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.retry_delay = 0.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.socket_keepalive_count = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.socket_keepalive_idle = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.socket_keepalive_interval = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.socket_timeout = 1.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.tls_allowed_ciphers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.tls_cafile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.tls_certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.tls_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.tls_keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cache.username = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] coordination.backend_url = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.asyncio_connection = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.asyncio_slave_connection = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.backend = sqlalchemy {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.connection = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.connection_debug = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.connection_parameters = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.connection_recycle_time = 3600 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.connection_trace = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.db_inc_retry_interval = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.db_max_retries = 20 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.db_max_retry_interval = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.db_retry_interval = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.max_overflow = 50 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.max_pool_size = 5 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.max_retries = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.mysql_wsrep_sync_wait = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.pool_timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.retry_interval = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.slave_connection = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.sqlite_synchronous = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.synchronous_reader = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] database.use_db_reconnect = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_tracing.insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.connection_string = messaging:// {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.es_doc_type = notification {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.es_scroll_size = 10000 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.es_scroll_time = 2m {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.filter_error_trace = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.hmac_keys = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.sentinel_service_name = mymaster {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.socket_timeout = 0.1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.trace_requests = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler.trace_sqlalchemy = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler_jaeger.process_tags = {} {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler_jaeger.service_name_prefix = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] profiler_otlp.service_name_prefix = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.enforce_new_defaults = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.policy_default_rule = default {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.policy_file = policy.yaml {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_policy.remote_timeout = 60.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.group = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.helper_command = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] privsep_osbrick.user = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.group = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.helper_command = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] cinder_sys_admin.user = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.auth_section = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.auth_type = password {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.cafile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.collect_timing = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.send_service_user_token = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.split_loggers = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.tls_ciphers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] service_user.tls_min_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.auth_section = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.auth_type = password {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.collect_timing = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.region_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.split_loggers = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.tls_ciphers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] glance.tls_min_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.backend_availability_zone = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.chap_password = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.chap_username = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.disk_geometry = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.driver_client_cert = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.driver_client_cert_key = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.driver_data_namespace = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.driver_use_ssl = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.enable_unsupported_driver = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.extra_capabilities = {} {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.filter_function = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.goodness_function = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.iscsi_target_flags = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.iscsi_write_cache = on {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.iser_helper = tgtadm {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.iser_ip_address = 192.168.122.63 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.iser_port = 3260 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.lvm_mirrors = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.lvm_share_target = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.lvm_type = auto {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.num_shell_tries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.nvmet_port_id = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.replication_device = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.report_discard_supported = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.reserved_percentage = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.scst_target_driver = iscsi {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.scst_target_iqn_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.storage_protocol = iSCSI {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.target_helper = tgtadm {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.target_ip_address = 192.168.122.63 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.target_port = 3260 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.target_protocol = iscsi {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.trace_flags = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.unique_fqdn_network = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.use_chap_auth = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_backend_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_clear = zero {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_clear_ionice = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_clear_size = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volume_group = cinder-volumes {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_reports.file_event_handler = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_reports.log_dir = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.backend_availability_zone = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.backend_host = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.chap_password = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.chap_username = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.chiscsi_conf = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.disk_geometry = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.driver_client_cert = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.driver_data_namespace = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.driver_use_ssl = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.extra_capabilities = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.filter_function = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.goodness_function = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.iser_helper = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.iser_ip_address = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.iser_port = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.iser_target_prefix = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.lvm_conf_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.lvm_mirrors = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.lvm_share_target = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.lvm_type = auto {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.num_shell_tries = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.nvmet_port_id = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.replication_device = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.report_discard_supported = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.reserved_percentage = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.scst_target_driver = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.storage_protocol = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.target_helper = lioadm {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.target_ip_address = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.target_port = 3260 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.target_protocol = iscsi {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.trace_flags = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.use_chap_auth = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_clear = zero {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_clear_size = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] lvmdriver-1.volumes_dir = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.ssl_version = {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_notifications.driver = [] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_notifications.retry = -1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] oslo_messaging_notifications.transport_url = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] key_manager.fixed_key = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.barbican_api_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.barbican_endpoint = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.barbican_endpoint_type = public {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.barbican_region_name = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.cafile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.collect_timing = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.number_of_retries = 60 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.retry_delay = 1 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.send_service_user_token = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.split_loggers = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.tls_ciphers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.tls_min_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.verify_ssl = True {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican.verify_ssl_path = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.auth_section = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.auth_type = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.cafile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.certfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.collect_timing = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.insecure = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.keyfile = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.split_loggers = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.timeout = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.tls_ciphers = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] barbican_service_user.tls_min_version = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.approle_role_id = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.approle_secret_id = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.auth_method = approle {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.auth_path = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.kv_mountpoint = secret {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.kv_path = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.kv_version = 2 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.namespace = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.root_token_id = **** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.ssl_ca_crt_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.timeout = 60.0 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.token_file = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.token_role = None {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.use_ssl = False {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:41:22 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] ******************************************************************************** {{(pid=77517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 13:41:22 devstack sudo[77684]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack sudo[77802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:22 devstack sudo[77802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:22 devstack sudo[77802]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:41:22 devstack cinder-volume[77676]: INFO cinder.brick.local_dev.lvm [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:22 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:22 devstack sudo[77903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:41:22 devstack sudo[77903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:23 devstack sudo[77903]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG cinder.brick.local_dev.lvm [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77676) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:23 devstack sudo[77992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:23 devstack sudo[77992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:23 devstack sudo[77992]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:23 devstack sudo[78172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:23 devstack sudo[78172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:24 devstack sudo[78172]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:24 devstack sudo[78286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 11 13:41:24 devstack sudo[78286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:24 devstack sudo[78286]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.264s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:24 devstack sudo[78289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:41:24 devstack sudo[78289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:24 devstack sudo[78289]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:24 devstack sudo[78373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:41:24 devstack sudo[78373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:24 devstack sudo[78373]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:25 devstack sudo[78380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:25 devstack sudo[78380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:25 devstack sudo[78380]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:25 devstack sudo[78445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:25 devstack sudo[78445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:25 devstack sudo[78445]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:25 devstack sudo[78475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:25 devstack sudo[78475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:25 devstack sudo[78475]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:25 devstack cinder-volume[77676]: INFO cinder.volume.drivers.lvm [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:25 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:25 devstack sudo[78479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:25 devstack sudo[78479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:26 devstack sudo[78479]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:26 devstack sudo[78482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:41:26 devstack sudo[78482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:26 devstack sudo[78482]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:26 devstack sudo[78485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:26 devstack sudo[78485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:26 devstack sudo[78485]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:26 devstack sudo[78488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:26 devstack sudo[78488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:26 devstack sudo[78488]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:26 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:26 devstack sudo[78491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:26 devstack sudo[78491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:27 devstack sudo[78491]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:27 devstack cinder-volume[77676]: INFO cinder.volume.driver [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Driver hasn't implemented _init_vendor_properties() Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG cinder.volume.driver [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_db.sqlalchemy.engines [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG dbcounter [-] [77676] Writer thread running {{(pid=77676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG cinder.db.api [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Building query based on filter {{(pid=77676) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG cinder.image.image_utils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 11 13:41:27 devstack cinder-volume[77676]: INFO cinder.keymgr.migration [None req-b54f8697-2be6-45b7-86d1-d5b231ba313d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:27 devstack sudo[78494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:41:27 devstack sudo[78494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:27 devstack sudo[78494]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:27 devstack sudo[78500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:27 devstack sudo[78500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:27 devstack sudo[78500]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:27 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:27 devstack sudo[78503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:27 devstack sudo[78503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:28 devstack sudo[78503]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:28 devstack sudo[78506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:28 devstack sudo[78506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:28 devstack sudo[78506]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG cinder.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Notifying Schedulers of capabilities ... {{(pid=77676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:41:28 devstack cinder-volume[77676]: INFO cinder.volume.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Driver initialization completed successfully. Sep 11 13:41:28 devstack cinder-volume[77676]: INFO cinder.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Initiating service 2 cleanup Sep 11 13:41:28 devstack cinder-volume[77676]: INFO cinder.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Service 2 cleanup completed. Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG cinder.service [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Creating RPC server for service cinder-volume {{(pid=77676) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG cinder.service [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77676) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 13:41:28 devstack cinder-volume[77676]: INFO cinder.volume.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:28 devstack sudo[78512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:41:28 devstack sudo[78512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:28 devstack sudo[78512]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:28 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:28 devstack sudo[78517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:28 devstack sudo[78517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:29 devstack sudo[78517]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:29 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:29 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:29 devstack sudo[78521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:41:29 devstack sudo[78521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:29 devstack sudo[78521]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:29 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:29 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:41:29 devstack sudo[78524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:41:29 devstack sudo[78524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:41:29 devstack sudo[78524]: pam_unix(sudo:session): session closed for user root Sep 11 13:41:29 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:41:29 devstack cinder-volume[77676]: INFO cinder.volume.manager [None req-d508fbd9-2d0f-4d28-9d10-9527241d5dbd None None] Driver post RPC initialization completed successfully. Sep 11 13:41:32 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:41:38 devstack cinder-volume[77676]: DEBUG dbcounter [-] [77676] Writing DB stats cinder:SELECT=4 {{(pid=77676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:41:39 devstack cinder-volume[77676]: DEBUG dbcounter [-] [77676] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:42:23 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:42:23 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:42:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:42:23 devstack sudo[80497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:42:23 devstack sudo[80497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:42:23 devstack sudo[80497]: pam_unix(sudo:session): session closed for user root Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:42:24 devstack sudo[80500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:42:24 devstack sudo[80500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:42:24 devstack sudo[80500]: pam_unix(sudo:session): session closed for user root Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:42:24 devstack sudo[80503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:42:24 devstack sudo[80503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:42:24 devstack sudo[80503]: pam_unix(sudo:session): session closed for user root Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:42:24 devstack sudo[80506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:42:24 devstack sudo[80506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:42:24 devstack sudo[80506]: pam_unix(sudo:session): session closed for user root Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG cinder.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Notifying Schedulers of capabilities ... {{(pid=77676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager._thread_info {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread count: 6 {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:42:24 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread info: [<_MainThread(MainThread, started 128695175831680)>, , , , , ] {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:43:23 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:43:23 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:43:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:43:23 devstack sudo[83807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:43:23 devstack sudo[83807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:43:24 devstack sudo[83807]: pam_unix(sudo:session): session closed for user root Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:43:24 devstack sudo[83811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:43:24 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:43:24 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:43:24 devstack sudo[83814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:43:24 devstack sudo[83814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:43:24 devstack sudo[83814]: pam_unix(sudo:session): session closed for user root Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:43:24 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:43:24 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:43:24 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG cinder.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Notifying Schedulers of capabilities ... {{(pid=77676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager._thread_info {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread count: 6 {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:43:24 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread info: [<_MainThread(MainThread, started 128695175831680)>, , , , , ] {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:43:39 devstack cinder-volume[77676]: DEBUG dbcounter [-] [77676] Writing DB stats cinder:SELECT=1 {{(pid=77676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:43:39 devstack cinder-volume[77676]: DEBUG dbcounter [-] [77676] Writing DB stats cinder:UPDATE=1 {{(pid=77676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:44:23 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:44:23 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:44:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:44:23 devstack sudo[85815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:44:23 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:44:24 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:44:24 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:44:24 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:44:24 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:44:24 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:44:24 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:44:24 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:44:24 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:44:24 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:44:24 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG cinder.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Notifying Schedulers of capabilities ... {{(pid=77676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager._thread_info {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread count: 6 {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:44:24 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread info: [<_MainThread(MainThread, started 128695175831680)>, , , , , ] {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:45:23 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:45:23 devstack cinder-volume[77676]: DEBUG cinder.volume.drivers.lvm [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Updating volume stats {{(pid=77676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 13:45:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:45:23 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 13:45:23 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:45:23 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Sep 11 13:45:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:45:23 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:45:24 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:45:24 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:45:24 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Sep 11 13:45:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:45:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:45:24 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 13:45:24 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:45:24 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Sep 11 13:45:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:45:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:45:24 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 13:45:24 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:45:24 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Sep 11 13:45:24 devstack cinder-volume[77676]: DEBUG oslo_concurrency.processutils [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:45:24 devstack cinder-volume[77676]: DEBUG cinder.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Notifying Schedulers of capabilities ... {{(pid=77676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:45:39 devstack cinder-volume[77676]: DEBUG dbcounter [-] [77676] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:46:23 devstack cinder-volume[77676]: DEBUG oslo_service.periodic_task [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] Running periodic task VolumeManager._thread_info {{(pid=77676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:46:23 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread count: 6 {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:46:23 devstack cinder-volume[77676]: DEBUG cinder.volume.manager [None req-2a0c08c3-8d6f-40a9-a4bb-b40262efb52d None None] thread info: [<_MainThread(MainThread, started 128695175831680)>, , , , , ] {{(pid=77676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:47:03 devstack cinder-volume[77517]: INFO oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Caught SIGTERM, stopping children Sep 11 13:47:03 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Acquiring lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:47:03 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Acquired lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:47:03 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Releasing lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:47:03 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Stop services. {{(pid=77517) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 13:47:03 devstack cinder-volume[77517]: DEBUG oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Killing children. {{(pid=77517) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 13:47:03 devstack cinder-volume[77517]: INFO oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Waiting on 1 children to exit Sep 11 13:47:03 devstack cinder-volume[77676]: DEBUG oslo_concurrency.lockutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Acquiring lock "singleton_lock" {{(pid=77676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:47:03 devstack cinder-volume[77676]: DEBUG oslo_concurrency.lockutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Acquired lock "singleton_lock" {{(pid=77676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:47:03 devstack cinder-volume[77676]: DEBUG oslo_concurrency.lockutils [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Releasing lock "singleton_lock" {{(pid=77676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:47:03 devstack cinder-volume[77676]: WARNING amqp [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 13:47:03 devstack cinder-volume[77676]: WARNING amqp [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 13:47:03 devstack cinder-volume[77517]: INFO oslo_service.backend._eventlet.service [None req-b35a4020-4fc8-4416-9e0b-5b47d52c7f2e None None] Child 77676 exited with status 0 Sep 11 13:47:03 devstack cinder-volume[87725]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 13:47:03 devstack cinder-volume[87725]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 13:47:03 devstack cinder-volume[87725]: we strongly recommend against using it for new projects. Sep 11 13:47:03 devstack cinder-volume[87725]: If you are already using Eventlet, we recommend migrating to a different Sep 11 13:47:03 devstack cinder-volume[87725]: framework. For more detail see Sep 11 13:47:03 devstack cinder-volume[87725]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 13:47:03 devstack cinder-volume[87725]: import eventlet # noqa Sep 11 13:47:06 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:47:06 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:47:06 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:47:06 devstack cinder-volume[87725]: INFO dbcounter [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Registered counter for database cinder Sep 11 13:47:06 devstack cinder-volume[87725]: DEBUG oslo_db.sqlalchemy.engines [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG dbcounter [-] [87725] Writer thread running {{(pid=87725) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 13:47:07 devstack cinder-volume[87725]: INFO cinder.rpc [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 13:47:07 devstack cinder-volume[87725]: INFO cinder.rpc [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_db.sqlalchemy.engines [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:07 devstack cinder-volume[87725]: INFO cinder.volume.manager [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Determined volume DB was empty at startup. Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG cinder.volume.manager [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87725) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 13:47:07 devstack cinder-volume[87725]: INFO cinder.volume.manager [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 13:47:07 devstack cinder-volume[87725]: WARNING stevedore.named [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 13:47:07 devstack cinder-volume[87725]: WARNING castellan.key_manager [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:47:07 devstack cinder-volume[87725]: WARNING cinder.keymgr.conf_key_mgr [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:47:07 devstack cinder-volume[87725]: INFO cinder.volume.manager [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_db.sqlalchemy.engines [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87725) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:07 devstack cinder-volume[87725]: INFO oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Starting 1 workers Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Started child 87942 {{(pid=87725) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Full set of CONF: {{(pid=87725) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] ******************************************************************************** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Configuration options gathered from: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] ================================================================================ {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] allow_availability_zone_fallback = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] allow_compression_on_image_upload = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] allowed_direct_url_schemes = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87942]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] api_rate_limit = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] auth_strategy = keystone {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_host = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_stats_polling_interval = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backup_api_class = cinder.backup.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backup_name_template = backup-%s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backup_use_same_host = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backup_use_temp_snapshot = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] chap_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] chap_username = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_internal_tenant_project_id = e6ea3cf2352441bf926cdac896a52bed {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_internal_tenant_user_id = 4b1e60ceaf904eb8b4fbee3949c25609 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cluster = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] compression_format = gzip {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] compute_api_class = cinder.compute.nova.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] config_dir = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] config_source = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] control_exchange = openstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] debug = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] default_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] default_group_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] default_volume_type = QuobyteHD {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] disk_geometry = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] driver_client_cert = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] driver_client_cert_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] driver_data_namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] driver_ssl_cert_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] driver_ssl_cert_verify = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] driver_use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] enable_new_services = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] enable_unsupported_driver = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] enabled_backends = ['QuobyteHD'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] enforce_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] filter_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_api_insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_api_servers = ['http://192.168.122.63/image'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_api_ssl_compression = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_ca_certificates_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_catalog_info = image:glance:publicURL {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_num_retries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance_request_timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] goodness_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] graceful_shutdown_timeout = 5 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] group_api_class = cinder.group.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] host = devstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_compress_on_upload = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_conversion_address_space_limit = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_conversion_cpu_limit = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_conversion_disable = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_upload_use_cinder_backend = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_upload_use_internal_tenant = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_volume_cache_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_volume_cache_max_count = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] image_volume_cache_max_size_gb = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] init_host_max_objects_retrieval = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] instance_format = [instance: %(uuid)s] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] iscsi_target_flags = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] iscsi_write_cache = on {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] iser_helper = tgtadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] iser_ip_address = 192.168.122.63 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] iser_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_color = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_config_append = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_dir = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_options = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_rotate_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_rotate_interval_type = days {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] log_rotation_type = none {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] max_age = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87942]: INFO cinder.volume.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.remotefs [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87942) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] max_logfile_count = 30 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] max_logfile_size_mb = 200 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] max_over_subscription_ratio = 20.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] message_reap_interval = 86400 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] message_ttl = 2592000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] migration_create_volume_timeout_secs = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] monkey_patch = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] monkey_patch_modules = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] my_ip = 192.168.122.63 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] no_snapshot_gb_quota = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] num_iser_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] num_shell_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] num_volume_device_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] nvmeof_conn_info_version = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] nvmet_ns_id = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] nvmet_port_id = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_max_limit = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_volume_ext_list = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_volume_listen_port = 8776 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_volume_use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] osapi_volume_workers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] per_volume_size_limit = -1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] periodic_fuzzy_delay = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] periodic_interval = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] public_endpoint = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] publish_errors = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_backup_gigabytes = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_backups = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_gigabytes = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_groups = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_snapshots = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] quota_volumes = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] rate_limit_burst = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] rate_limit_except_level = CRITICAL {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] rate_limit_interval = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] reinit_driver_count = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] replication_device = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] report_discard_supported = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] report_interval = 120 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] reservation_clean_interval = 86400 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] reservation_expire = 86400 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] reserved_image_namespaces = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] reserved_percentage = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] rpc_response_timeout = 120 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] run_external_periodic_tasks = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] scst_target_driver = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] scst_target_iqn_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_down_time = 720 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] shell_completion = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] snapshot_name_template = snapshot-%s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] state_path = /opt/stack/data/cinder {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] storage_availability_zone = nova {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] storage_protocol = iSCSI {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] syslog_log_facility = LOG_USER {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] target_helper = lioadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] target_ip_address = 192.168.122.63 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] target_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] target_protocol = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] target_secondary_ip_addresses = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] trace_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] transport_url = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] until_refresh = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_chap_auth = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_default_quota_class = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_journal = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_json = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_stderr = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] use_syslog = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] verify_glance_signatures = enabled {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_api_class = cinder.volume.api.API {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_backend_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_clear = zero {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_clear_ionice = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_clear_size = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_copy_bps_limit = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_dd_blocksize = 1M {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_name_template = volume-%s {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_service_inithost_offload = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volume_usage_audit_period = month {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] zoning_mode = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_concurrency.disable_process_locking = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.auth_type = password {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.auth_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.cache = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.include_service_catalog = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.interface = public {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcache_username = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.region_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.service_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.63/identity {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.backend = dogpile.cache.null {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.backend_argument = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.backend_expiration_time = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.config_prefix = cache.oslo {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.debug_cache_backend = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.enable_retry_client = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.enable_socket_keepalive = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.expiration_time = 600 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.hashclient_retry_attempts = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_dead_retry = 300 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_pool_maxsize = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_sasl_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.proxies = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87942) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 13:47:07 devstack cinder-volume[87942]: WARNING cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 13:47:07 devstack cinder-volume[87942]: WARNING cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.redis_db = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.redis_server = localhost:6379 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.retry_attempts = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.retry_delay = 0.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.socket_keepalive_count = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.socket_keepalive_idle = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.socket_keepalive_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.socket_timeout = 1.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Running cmd (subprocess): mount.quobyte {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.tls_allowed_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.tls_cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.tls_certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.tls_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.tls_keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cache.username = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] coordination.backend_url = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.asyncio_connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.asyncio_slave_connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.backend = sqlalchemy {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.connection_debug = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.connection_parameters = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.connection_recycle_time = 3600 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.connection_trace = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.db_inc_retry_interval = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.db_max_retries = 20 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.db_max_retry_interval = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.db_retry_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.max_overflow = 50 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.max_pool_size = 5 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.max_retries = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.mysql_wsrep_sync_wait = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.pool_timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.retry_interval = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.slave_connection = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.sqlite_synchronous = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.synchronous_reader = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] database.use_db_reconnect = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_tracing.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.connection_string = messaging:// {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.es_doc_type = notification {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.es_scroll_size = 10000 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.es_scroll_time = 2m {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.filter_error_trace = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.hmac_keys = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.sentinel_service_name = mymaster {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.socket_timeout = 0.1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.trace_requests = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler.trace_sqlalchemy = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler_jaeger.process_tags = {} {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler_jaeger.service_name_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] profiler_otlp.service_name_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.enforce_new_defaults = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.policy_default_rule = default {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.policy_file = policy.yaml {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.group = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.helper_command = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] privsep_osbrick.user = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.group = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.helper_command = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] cinder_sys_admin.user = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.auth_type = password {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.send_service_user_token = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] service_user.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.auth_type = password {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.region_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] glance.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.backend_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.chap_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.chap_username = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.disk_geometry = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack quobyte-client[87947]: Reading configuration file: /etc/quobyte/client.cfg Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.driver_client_cert = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.driver_client_cert_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.driver_data_namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.driver_use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack quobyte-client[87947]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.extra_capabilities = {} {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=87942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:47:07 devstack cinder-volume[87942]: INFO cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af ... Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.filter_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad -c /etc/quobyte/client-cinder.cfg {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.goodness_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.iscsi_target_flags = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.iscsi_write_cache = on {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.iser_helper = tgtadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.iser_ip_address = 192.168.122.63 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.iser_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_host = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_login = admin {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_mount_options = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_private_key = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_share_path = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.num_shell_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.quobyte_volume_url = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.replication_device = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.report_discard_supported = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.reserved_percentage = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.target_helper = tgtadm {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.target_ip_address = 192.168.122.63 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.target_port = 3260 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad -c /etc/quobyte/client-cinder.cfg Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.target_protocol = iscsi {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.trace_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.unique_fqdn_network = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.use_chap_auth = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_backend_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_clear = zero {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_clear_ionice = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_clear_size = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_reports.file_event_handler = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_reports.log_dir = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.backend_availability_zone = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.backend_host = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.chap_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.chap_username = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.chiscsi_conf = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.disk_geometry = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.driver_client_cert = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.driver_data_namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.driver_use_ssl = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.extra_capabilities = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.filter_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.goodness_function = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.iser_helper = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.iser_ip_address = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.iser_port = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.iser_target_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_host = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_login = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_mount_options = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_password = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_private_key = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_share_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_ssh_port = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.num_shell_tries = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.nvmet_port_id = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.replication_device = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.report_discard_supported = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.reserved_percentage = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.scst_target_driver = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.storage_protocol = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.target_helper = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.target_ip_address = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.target_port = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.target_prefix = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.target_protocol = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.trace_flags = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.use_chap_auth = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_clear = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_clear_size = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] QuobyteHD.volumes_dir = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_notifications.driver = [] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_notifications.retry = -1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] key_manager.fixed_key = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.barbican_api_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.barbican_endpoint = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.barbican_endpoint_type = public {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.barbican_region_name = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.number_of_retries = 60 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.retry_delay = 1 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.send_service_user_token = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.verify_ssl = True {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican.verify_ssl_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.auth_section = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.auth_type = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.cafile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.certfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.collect_timing = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.insecure = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.keyfile = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.split_loggers = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.timeout = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.tls_ciphers = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] barbican_service_user.tls_min_version = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.approle_role_id = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.approle_secret_id = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.auth_method = approle {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.auth_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.kv_mountpoint = secret {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.kv_path = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.kv_version = 2 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.namespace = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.root_token_id = **** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.ssl_ca_crt_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.timeout = 60.0 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.token_file = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.token_role = None {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.use_ssl = False {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:07 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] ******************************************************************************** {{(pid=87725) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 13:47:08 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.492s {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:08 devstack cinder-volume[87942]: INFO cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af succeeded Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=87942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.504s {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:08 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:47:08 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:08 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.243s {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:08 devstack cinder-volume[87942]: INFO cinder.volume.driver [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.volume.driver [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2129020690918, 'free_capacity_gb': 1773.2129020690918, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87942) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_db.sqlalchemy.engines [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG dbcounter [-] [87942] Writer thread running {{(pid=87942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.db.api [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Building query based on filter {{(pid=87942) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.image.image_utils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87942) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 11 13:47:08 devstack cinder-volume[87942]: INFO cinder.keymgr.migration [None req-142b6164-e8b9-4147-835f-bd04adc03a8b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=87942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=87942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:08 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:47:08 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:08 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.232s {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Notifying Schedulers of capabilities ... {{(pid=87942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:47:08 devstack cinder-volume[87942]: INFO cinder.volume.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Driver initialization completed successfully. Sep 11 13:47:08 devstack cinder-volume[87942]: INFO cinder.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Initiating service 3 cleanup Sep 11 13:47:08 devstack cinder-volume[87942]: INFO cinder.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Service 3 cleanup completed. Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.service [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Creating RPC server for service cinder-volume {{(pid=87942) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 13:47:08 devstack cinder-volume[87942]: DEBUG cinder.service [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87942) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 13:47:09 devstack cinder-volume[87942]: INFO cinder.volume.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=87942) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG cinder.volume.drivers.quobyte [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=87942) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87942) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:09 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:47:09 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:09 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:09 devstack cinder-volume[87942]: DEBUG oslo_concurrency.processutils [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.249s {{(pid=87942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:09 devstack cinder-volume[87942]: INFO cinder.volume.manager [None req-6a7fad5d-61d5-493c-896b-30cb4fffe647 None None] Driver post RPC initialization completed successfully. Sep 11 13:47:13 devstack cinder-volume[87725]: INFO oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Caught SIGTERM, stopping children Sep 11 13:47:13 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Acquiring lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:47:13 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Acquired lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:47:13 devstack cinder-volume[87725]: DEBUG oslo_concurrency.lockutils [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Releasing lock "singleton_lock" {{(pid=87725) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:47:13 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Stop services. {{(pid=87725) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 13:47:13 devstack cinder-volume[87725]: DEBUG oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Killing children. {{(pid=87725) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 13:47:13 devstack cinder-volume[87725]: INFO oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Waiting on 1 children to exit Sep 11 13:47:16 devstack cinder-volume[87942]: DEBUG oslo_service.periodic_task [None req-f6412188-164d-4831-9fbf-92c5c0a76ad2 None None] Running periodic task VolumeManager._thread_info {{(pid=87942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:47:16 devstack cinder-volume[87942]: DEBUG cinder.volume.manager [None req-f6412188-164d-4831-9fbf-92c5c0a76ad2 None None] thread count: 6 {{(pid=87942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:47:16 devstack cinder-volume[87942]: DEBUG cinder.volume.manager [None req-f6412188-164d-4831-9fbf-92c5c0a76ad2 None None] thread info: [<_MainThread(MainThread, started 125792807583872)>, , , , , ] {{(pid=87942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:47:17 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Acquiring lock "singleton_lock" {{(pid=87942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:47:17 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Acquired lock "singleton_lock" {{(pid=87942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:47:17 devstack cinder-volume[87942]: DEBUG oslo_concurrency.lockutils [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Releasing lock "singleton_lock" {{(pid=87942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:47:17 devstack cinder-volume[87942]: WARNING amqp [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 13:47:17 devstack cinder-volume[87942]: WARNING amqp [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 13:47:17 devstack cinder-volume[87725]: INFO oslo_service.backend._eventlet.service [None req-d938a0a8-e96e-4fae-8726-fda80c969cb6 None None] Child 87942 exited with status 0 Sep 11 13:47:18 devstack cinder-volume[88406]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 13:47:18 devstack cinder-volume[88406]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 13:47:18 devstack cinder-volume[88406]: we strongly recommend against using it for new projects. Sep 11 13:47:18 devstack cinder-volume[88406]: If you are already using Eventlet, we recommend migrating to a different Sep 11 13:47:18 devstack cinder-volume[88406]: framework. For more detail see Sep 11 13:47:18 devstack cinder-volume[88406]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 13:47:18 devstack cinder-volume[88406]: import eventlet # noqa Sep 11 13:47:20 devstack cinder-volume[88406]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 13:47:20 devstack cinder-volume[88406]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 13:47:20 devstack cinder-volume[88406]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 13:47:21 devstack cinder-volume[88406]: INFO dbcounter [None req-d143be70-2054-4c39-9176-5180de03120c None None] Registered counter for database cinder Sep 11 13:47:21 devstack cinder-volume[88406]: DEBUG oslo_db.sqlalchemy.engines [None req-d143be70-2054-4c39-9176-5180de03120c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:21 devstack cinder-volume[88406]: DEBUG dbcounter [-] [88406] Writer thread running {{(pid=88406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 13:47:21 devstack cinder-volume[88406]: INFO cinder.rpc [None req-d143be70-2054-4c39-9176-5180de03120c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 13:47:21 devstack cinder-volume[88406]: INFO cinder.rpc [None req-d143be70-2054-4c39-9176-5180de03120c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 13:47:21 devstack cinder-volume[88406]: DEBUG oslo_db.sqlalchemy.engines [None req-d143be70-2054-4c39-9176-5180de03120c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:21 devstack cinder-volume[88406]: INFO cinder.volume.manager [None req-d143be70-2054-4c39-9176-5180de03120c None None] Determined volume DB was empty at startup. Sep 11 13:47:21 devstack cinder-volume[88406]: DEBUG cinder.volume.manager [None req-d143be70-2054-4c39-9176-5180de03120c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88406) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 13:47:21 devstack cinder-volume[88406]: WARNING stevedore.named [None req-d143be70-2054-4c39-9176-5180de03120c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 13:47:21 devstack cinder-volume[88406]: WARNING castellan.key_manager [None req-d143be70-2054-4c39-9176-5180de03120c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:47:21 devstack cinder-volume[88406]: WARNING cinder.keymgr.conf_key_mgr [None req-d143be70-2054-4c39-9176-5180de03120c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 13:47:21 devstack cinder-volume[88406]: INFO cinder.volume.manager [None req-d143be70-2054-4c39-9176-5180de03120c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 13:47:21 devstack cinder-volume[88406]: DEBUG oslo_db.sqlalchemy.engines [None req-d143be70-2054-4c39-9176-5180de03120c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:22 devstack cinder-volume[88406]: INFO oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] Starting 1 workers Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] Started child 88731 {{(pid=88406) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] Full set of CONF: {{(pid=88406) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] ******************************************************************************** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] Configuration options gathered from: {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] ================================================================================ {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] allow_availability_zone_fallback = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] allow_compression_on_image_upload = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] allowed_direct_url_schemes = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] api_rate_limit = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] auth_strategy = keystone {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_availability_zone = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_host = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_stats_polling_interval = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backup_api_class = cinder.backup.api.API {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backup_name_template = backup-%s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backup_use_same_host = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backup_use_temp_snapshot = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] chap_password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88731]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] chap_username = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_internal_tenant_project_id = e6ea3cf2352441bf926cdac896a52bed {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_internal_tenant_user_id = 4b1e60ceaf904eb8b4fbee3949c25609 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cluster = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] compression_format = gzip {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] compute_api_class = cinder.compute.nova.API {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] config_dir = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] config_source = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] control_exchange = openstack {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] debug = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] default_availability_zone = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] default_group_type = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] default_volume_type = QuobyteHD {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] disk_geometry = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] driver_client_cert = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] driver_client_cert_key = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] driver_data_namespace = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] driver_ssl_cert_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] driver_ssl_cert_verify = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] driver_use_ssl = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] enable_new_services = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] enable_unsupported_driver = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] enabled_backends = ['QuobyteHD'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] enforce_multipath_for_image_xfer = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] filter_function = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_api_insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_api_servers = ['http://192.168.122.63/image'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_api_ssl_compression = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_ca_certificates_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_catalog_info = image:glance:publicURL {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_num_retries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance_request_timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] goodness_function = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] graceful_shutdown_timeout = 5 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] group_api_class = cinder.group.api.API {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] host = devstack {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_compress_on_upload = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_conversion_address_space_limit = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_conversion_cpu_limit = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_conversion_disable = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_upload_use_cinder_backend = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_upload_use_internal_tenant = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_volume_cache_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_volume_cache_max_count = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] image_volume_cache_max_size_gb = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] init_host_max_objects_retrieval = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] instance_format = [instance: %(uuid)s] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] iscsi_target_flags = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] iscsi_write_cache = on {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] iser_helper = tgtadm {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] iser_ip_address = 192.168.122.63 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] iser_port = 3260 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_color = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_config_append = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_dir = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_options = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_rotate_interval = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_rotate_interval_type = days {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] log_rotation_type = none {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] max_age = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] max_logfile_count = 30 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] max_logfile_size_mb = 200 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] max_over_subscription_ratio = 20.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] message_reap_interval = 86400 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] message_ttl = 2592000 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] migration_create_volume_timeout_secs = 300 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] monkey_patch = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] monkey_patch_modules = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] my_ip = 192.168.122.63 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] no_snapshot_gb_quota = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] num_iser_scan_tries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] num_shell_tries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] num_volume_device_scan_tries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] nvmeof_conn_info_version = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] nvmet_ns_id = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] nvmet_port_id = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_max_limit = 1000 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_volume_ext_list = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_volume_listen = 0.0.0.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_volume_listen_port = 8776 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_volume_use_ssl = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] osapi_volume_workers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] per_volume_size_limit = -1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] periodic_fuzzy_delay = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] periodic_interval = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] project_id_regex = [0-9a-f\-]+ {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] public_endpoint = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] publish_errors = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_backup_gigabytes = 1000 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_backups = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_gigabytes = 1000 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_groups = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_snapshots = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] quota_volumes = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] rate_limit_burst = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] rate_limit_except_level = CRITICAL {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] rate_limit_interval = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] reinit_driver_count = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] replication_device = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] report_discard_supported = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] report_interval = 120 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] reservation_clean_interval = 86400 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] reservation_expire = 86400 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] reserved_image_namespaces = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] reserved_percentage = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] rpc_response_timeout = 120 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] run_external_periodic_tasks = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] scst_target_driver = iscsi {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] scst_target_iqn_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_down_time = 720 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] shell_completion = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] snapshot_name_template = snapshot-%s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] split_loggers = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] state_path = /opt/stack/data/cinder {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] storage_availability_zone = nova {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] storage_protocol = iSCSI {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] syslog_log_facility = LOG_USER {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] target_helper = lioadm {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] target_ip_address = 192.168.122.63 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] target_port = 3260 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] target_protocol = iscsi {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] target_secondary_ip_addresses = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] trace_flags = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] transfer_api_class = cinder.transfer.api.API {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] transport_url = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] until_refresh = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_chap_auth = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_default_quota_class = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_journal = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_json = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_multipath_for_image_xfer = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_stderr = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] use_syslog = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] verify_glance_signatures = enabled {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_api_class = cinder.volume.api.API {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_backend_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_clear = zero {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_clear_ionice = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_clear_size = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_copy_bps_limit = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_dd_blocksize = 1M {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_name_template = volume-%s {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_service_inithost_offload = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volume_usage_audit_period = month {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] zoning_mode = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_concurrency.disable_process_locking = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88731) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.auth_section = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.auth_type = password {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.auth_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.cache = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.delay_auth_decision = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.http_connect_timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.include_service_catalog = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.interface = public {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcache_username = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.region_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.service_token_roles_required = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.service_type = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.token_cache_time = 300 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.63/identity {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.backend = dogpile.cache.null {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.backend_argument = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.backend_expiration_time = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.config_prefix = cache.oslo {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.debug_cache_backend = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.enable_retry_client = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.enable_socket_keepalive = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.expiration_time = 600 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.hashclient_retry_attempts = 2 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_dead_retry = 300 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_pool_maxsize = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_sasl_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.proxies = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.redis_db = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.redis_sentinel_service_name = mymaster {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.redis_server = localhost:6379 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.retry_attempts = 2 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.retry_delay = 0.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.socket_keepalive_count = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.socket_keepalive_idle = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.socket_keepalive_interval = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.socket_timeout = 1.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.tls_allowed_ciphers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.tls_cafile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.tls_certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.tls_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.tls_keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cache.username = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] coordination.backend_url = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.asyncio_connection = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.asyncio_slave_connection = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.backend = sqlalchemy {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.connection = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.connection_debug = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.connection_parameters = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.connection_recycle_time = 3600 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.connection_trace = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.db_inc_retry_interval = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.db_max_retries = 20 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.db_max_retry_interval = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.db_retry_interval = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.max_overflow = 50 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.max_pool_size = 5 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.max_retries = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.mysql_wsrep_sync_wait = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.pool_timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.retry_interval = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.slave_connection = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.sqlite_synchronous = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.synchronous_reader = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] database.use_db_reconnect = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_tracing.insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88731) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.connection_string = messaging:// {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 13:47:22 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.es_doc_type = notification {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.es_scroll_size = 10000 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.es_scroll_time = 2m {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.filter_error_trace = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Running cmd (subprocess): mount.quobyte {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.hmac_keys = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.sentinel_service_name = mymaster {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.socket_timeout = 0.1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.trace_requests = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler.trace_sqlalchemy = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler_jaeger.process_tags = {} {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler_jaeger.service_name_prefix = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] profiler_otlp.service_name_prefix = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.enforce_new_defaults = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.policy_default_rule = default {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.policy_file = policy.yaml {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_policy.remote_timeout = 60.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.group = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.helper_command = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] privsep_osbrick.user = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.group = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.helper_command = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] cinder_sys_admin.user = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.auth_section = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.auth_type = password {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.cafile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.collect_timing = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.send_service_user_token = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.split_loggers = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.tls_ciphers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] service_user.tls_min_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.auth_section = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.auth_type = password {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.collect_timing = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.region_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.split_loggers = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.tls_ciphers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] glance.tls_min_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.backend_availability_zone = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.chap_password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.chap_username = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.disk_geometry = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.driver_client_cert = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.driver_client_cert_key = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.driver_data_namespace = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.driver_use_ssl = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.enable_unsupported_driver = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.extra_capabilities = {} {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.filter_function = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.goodness_function = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.iscsi_target_flags = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.iscsi_write_cache = on {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.iser_helper = tgtadm {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.iser_ip_address = 192.168.122.63 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.iser_port = 3260 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_host = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_login = admin {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_mount_options = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_private_key = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_share_path = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_ssh_port = 22 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.num_shell_tries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.nvmet_port_id = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_client_cfg = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack quobyte-client[88732]: Reading configuration file: /etc/quobyte/client.cfg Sep 11 13:47:22 devstack quobyte-client[88732]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.quobyte_volume_url = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.replication_device = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.report_discard_supported = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.reserved_percentage = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.scst_target_driver = iscsi {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.scst_target_iqn_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.storage_protocol = iSCSI {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.target_helper = tgtadm {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.target_ip_address = 192.168.122.63 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.target_port = 3260 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.target_protocol = iscsi {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.trace_flags = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.unique_fqdn_network = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.use_chap_auth = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_backend_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_clear = zero {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_clear_ionice = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_clear_size = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_reports.file_event_handler = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_reports.log_dir = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.backend_availability_zone = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.backend_host = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.chap_password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.chap_username = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.chiscsi_conf = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.disk_geometry = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.driver_client_cert = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.driver_client_cert_key = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.driver_data_namespace = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.driver_use_ssl = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.extra_capabilities = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.filter_function = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.goodness_function = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.iscsi_target_flags = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.iscsi_write_cache = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.iser_helper = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.iser_ip_address = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.iser_port = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.iser_target_prefix = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_host = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_login = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_mount_options = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_password = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_private_key = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_share_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_ssh_port = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.num_shell_tries = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nvmet_ns_id = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.nvmet_port_id = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.replication_device = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.report_discard_supported = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.reserved_percentage = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.scst_target_driver = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.storage_protocol = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.target_helper = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.target_ip_address = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.target_port = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.target_prefix = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.target_protocol = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.trace_flags = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.unique_fqdn_network = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.use_chap_auth = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_clear = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_clear_ionice = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_clear_size = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] QuobyteHD.volumes_dir = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.ssl_version = {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_notifications.driver = [] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_notifications.retry = -1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] oslo_messaging_notifications.transport_url = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] key_manager.fixed_key = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.barbican_api_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.barbican_endpoint = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.barbican_endpoint_type = public {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.barbican_region_name = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.cafile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.collect_timing = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.number_of_retries = 60 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.retry_delay = 1 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.send_service_user_token = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.split_loggers = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.tls_ciphers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.tls_min_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.verify_ssl = True {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican.verify_ssl_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.auth_section = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.auth_type = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.cafile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.certfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.collect_timing = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.insecure = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.keyfile = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.split_loggers = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.timeout = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.tls_ciphers = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] barbican_service_user.tls_min_version = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.approle_role_id = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.approle_secret_id = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.auth_method = approle {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.auth_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.kv_mountpoint = secret {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.kv_path = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.kv_version = 2 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.namespace = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.root_token_id = **** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.ssl_ca_crt_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.timeout = 60.0 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.token_file = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.token_role = None {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.use_ssl = False {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 13:47:22 devstack cinder-volume[88406]: DEBUG oslo_service.backend._eventlet.service [None req-d143be70-2054-4c39-9176-5180de03120c None None] ******************************************************************************** {{(pid=88406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 13:47:22 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:22 devstack cinder-volume[88731]: INFO cinder.volume.driver [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.driver [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2129020690918, 'free_capacity_gb': 1773.2129020690918, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88731) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_db.sqlalchemy.engines [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writer thread running {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.db.api [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Building query based on filter {{(pid=88731) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88731) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:22 devstack cinder-volume[88731]: INFO cinder.keymgr.migration [None req-8e55bbdd-6445-4667-9131-7064711f60dc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 13:47:22 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:47:22 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:22 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.296s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:22 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:47:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Driver initialization completed successfully. Sep 11 13:47:23 devstack cinder-volume[88731]: INFO cinder.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Initiating service 3 cleanup Sep 11 13:47:23 devstack cinder-volume[88731]: INFO cinder.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Service 3 cleanup completed. Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG cinder.service [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Creating RPC server for service cinder-volume {{(pid=88731) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG cinder.service [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88731) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 13:47:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:47:23 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:47:23 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:47:23 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Sep 11 13:47:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:47:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1dadfcb3-11e4-4ec0-825f-a75f4268cfe7 None None] Driver post RPC initialization completed successfully. Sep 11 13:47:32 devstack cinder-volume[88406]: DEBUG dbcounter [-] [88406] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:47:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=5 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:48:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:48:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 6 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:48:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Flow 'volume_create_manager' (03ccd1f4-85a4-4a95-a349-7712a939f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b00d8a-39d6-491c-adf4-50ffdc482a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b00d8a-39d6-491c-adf4-50ffdc482a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-82816721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ef47c3-4f83-41f4-9cdb-5b70767b077e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1ba7e48f8341e48432e860d4278a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:48:20Z,use_quota=True,user_id='4ae36273178147aabedae523135beefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44320ea7-581d-4870-beac-a03787a39ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44320ea7-581d-4870-beac-a03787a39ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a60dda4-17d4-43b5-a134-a72dd6b76533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a60dda4-17d4-43b5-a134-a72dd6b76533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ef47c3-4f83-41f4-9cdb-5b70767b077e', 'volume_name': 'volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7af515-75bf-4d04-8b1c-67c897eca744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7af515-75bf-4d04-8b1c-67c897eca744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b76930-5e2b-4cb3-af7b-d28bf6c1d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:20 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Volume d9ef47c3-4f83-41f4-9cdb-5b70767b077e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e', 'volume_size': 1} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-82816721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ef47c3-4f83-41f4-9cdb-5b70767b077e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1ba7e48f8341e48432e860d4278a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:48:20Z,use_quota=True,user_id='4ae36273178147aabedae523135beefa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Creating volume d9ef47c3-4f83-41f4-9cdb-5b70767b077e {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:48:20 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:48:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:20 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e 1073741824 Sep 11 13:48:20 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:21 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e 1073741824" returned: 0 in 0.806s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:21 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e Sep 11 13:48:21 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:21 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e" returned: 0 in 0.301s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b76930-5e2b-4cb3-af7b-d28bf6c1d063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0566c5f2-8030-45e5-b8d7-acbe25fee80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:21 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Volume volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e (d9ef47c3-4f83-41f4-9cdb-5b70767b077e): created successfully Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0566c5f2-8030-45e5-b8d7-acbe25fee80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Flow 'volume_create_manager' (03ccd1f4-85a4-4a95-a349-7712a939f70c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:48:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-58ffac0d-f1a2-4976-8564-ad05a66aac58 tempest-TaggedAttachmentsTest-484817100 None] Created volume successfully. Sep 11 13:48:31 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:48:31 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Flow 'volume_create_manager' (feb2754b-5ba9-4e19-a535-e0cd94caea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188d2f95-2222-4a66-9d83-7a4298b77700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188d2f95-2222-4a66-9d83-7a4298b77700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-654182652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b604f88-651c-45fd-a34f-e98dbf50c228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8453a80c0ed841e1aa9ff4f3ca3ffde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:48:46Z,use_quota=True,user_id='a5d1fa8e85c940bbb7c308145178e6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f198a34-a8b8-49e6-bd09-889975e487e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f198a34-a8b8-49e6-bd09-889975e487e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b8b0d1-32b4-44e8-859e-3c74c2680fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b8b0d1-32b4-44e8-859e-3c74c2680fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b604f88-651c-45fd-a34f-e98dbf50c228', 'volume_name': 'volume-9b604f88-651c-45fd-a34f-e98dbf50c228', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f3e5bf-a317-409b-89d6-d354ec6cc1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f3e5bf-a317-409b-89d6-d354ec6cc1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bf36e1-2e11-47ea-863e-ba1d1fc79039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:46 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Volume 9b604f88-651c-45fd-a34f-e98dbf50c228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b604f88-651c-45fd-a34f-e98dbf50c228', 'volume_size': 1} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-654182652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b604f88-651c-45fd-a34f-e98dbf50c228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8453a80c0ed841e1aa9ff4f3ca3ffde8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:48:46Z,use_quota=True,user_id='a5d1fa8e85c940bbb7c308145178e6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Creating volume 9b604f88-651c-45fd-a34f-e98dbf50c228 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:48:46 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:48:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:46 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 1073741824 Sep 11 13:48:46 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:47 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 1073741824" returned: 0 in 0.882s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:47 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 Sep 11 13:48:47 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:48 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228" returned: 0 in 0.643s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bf36e1-2e11-47ea-863e-ba1d1fc79039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b604f88-651c-45fd-a34f-e98dbf50c228', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ce6913-cc29-43e1-9e2a-12f25d306917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:48:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Volume volume-9b604f88-651c-45fd-a34f-e98dbf50c228 (9b604f88-651c-45fd-a34f-e98dbf50c228): created successfully Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ce6913-cc29-43e1-9e2a-12f25d306917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:48:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Flow 'volume_create_manager' (feb2754b-5ba9-4e19-a535-e0cd94caea4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:48:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f0fd830c-63af-44ad-bcd3-512c8be20087 tempest-VolumesAdminNegativeTest-15684349 None] Created volume successfully. Sep 11 13:48:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Acquiring lock "cinder-9b604f88-651c-45fd-a34f-e98dbf50c228-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:48:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Lock "cinder-9b604f88-651c-45fd-a34f-e98dbf50c228-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:48:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Acquiring lock "cinder-quobyte-9b604f88-651c-45fd-a34f-e98dbf50c228" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:48:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Lock "cinder-quobyte-9b604f88-651c-45fd-a34f-e98dbf50c228" acquired by "delete_volume" :: waited 0.056s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:48:49 devstack cinder-volume[88731]: INFO oslo.privsep.daemon [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpezoq8arz/privsep.sock'] Sep 11 13:48:49 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpezoq8arz/privsep.sock Sep 11 13:48:49 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 13:48:52 devstack cinder-volume[88731]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 11 13:48:52 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:52 devstack cinder-volume[88731]: INFO oslo.privsep.daemon [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Spawned new privsep daemon via rootwrap Sep 11 13:48:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Accepted privsep connection to /tmp/tmpezoq8arz/privsep.sock {{(pid=88731) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 11 13:48:52 devstack cinder-volume[88731]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 11 13:48:52 devstack cinder-volume[88731]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 11 13:48:52 devstack cinder-volume[88731]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 11 13:48:52 devstack cinder-volume[88731]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89760 Sep 11 13:48:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88d3ef8-ee52-48df-b8b7-a42e761a7189]: (2,) {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:48:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[267a20a9-2391-4e25-94eb-a2167272fd58]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:48:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:53 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 Sep 11 13:48:53 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:53 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228" returned: 0 in 1.105s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:53 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228 Sep 11 13:48:53 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:54 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b604f88-651c-45fd-a34f-e98dbf50c228" returned: 0 in 0.710s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Lock "cinder-quobyte-9b604f88-651c-45fd-a34f-e98dbf50c228" released by "delete_volume" :: held 4.929s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:48:54 devstack cinder-volume[88731]: WARNING cinder.quota [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:48:54 devstack cinder-volume[88731]: WARNING cinder.quota [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:48:54 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Created reservations ['6d4ab5c9-48c0-43ee-8782-51d4528fe1a4', 'ec89acd9-fb69-4f1a-bce6-64662521c974', 'f78a7748-4225-42f7-b654-94c80ca217d3', '23356f8b-e917-4cc4-af7c-61a6a355051a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:48:55 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:48:55 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:48:55 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.433s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:48:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Deleted volume successfully. Sep 11 13:48:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-355b7acd-5081-4af8-8277-680f909a606c tempest-VolumesAdminNegativeTest-15684349 None] Lock "cinder-9b604f88-651c-45fd-a34f-e98dbf50c228-delete_volume" released by "delete_volume" :: held 6.124s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Flow 'volume_create_manager' (389cbda9-a947-4885-b3cb-d0260d5da205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9704aa77-4473-4138-9e2e-88a54a59c2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9704aa77-4473-4138-9e2e-88a54a59c2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1060263472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b0c5bf-50e6-4048-9c96-efcb140a3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807fc99c87ea4840a0dbacbec7dc3b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:49:04Z,use_quota=True,user_id='81a47cca212341d98a361f84ea051c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f051050c-4dbb-441a-ba0a-2521ec23b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f051050c-4dbb-441a-ba0a-2521ec23b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee1a5a6-25db-43bf-9917-41cb56af4045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee1a5a6-25db-43bf-9917-41cb56af4045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b0c5bf-50e6-4048-9c96-efcb140a3784', 'volume_name': 'volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec24185-9dea-45af-9c44-406f5d8f260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec24185-9dea-45af-9c44-406f5d8f260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00d998e-2a7a-4fdb-9d62-4bd39da51029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Volume b6b0c5bf-50e6-4048-9c96-efcb140a3784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784', 'volume_size': 1} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1060263472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b0c5bf-50e6-4048-9c96-efcb140a3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807fc99c87ea4840a0dbacbec7dc3b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:49:04Z,use_quota=True,user_id='81a47cca212341d98a361f84ea051c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Creating volume b6b0c5bf-50e6-4048-9c96-efcb140a3784 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:49:04 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:49:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:04 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 1073741824 Sep 11 13:49:04 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:05 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 1073741824" returned: 0 in 0.634s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:05 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 Sep 11 13:49:05 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:05 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784" returned: 0 in 0.428s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00d998e-2a7a-4fdb-9d62-4bd39da51029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2dc81e-9b77-4697-bb4e-5934be19e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Volume volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 (b6b0c5bf-50e6-4048-9c96-efcb140a3784): created successfully Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2dc81e-9b77-4697-bb4e-5934be19e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Flow 'volume_create_manager' (389cbda9-a947-4885-b3cb-d0260d5da205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:49:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f2f48cd4-b03c-41ec-8c42-444b1ae1d9d9 tempest-ServersNegativeTestJSON-1086256999 None] Created volume successfully. Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Flow 'volume_create_manager' (27481cb0-99b4-490f-b758-56835ffd32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b346d18-9120-4ae3-b514-c478baa9a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b346d18-9120-4ae3-b514-c478baa9a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-983757326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807fc99c87ea4840a0dbacbec7dc3b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:49:10Z,use_quota=True,user_id='81a47cca212341d98a361f84ea051c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed82496-65f5-4bd2-95fa-d9df9c4eb7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed82496-65f5-4bd2-95fa-d9df9c4eb7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c95bb0-07e9-4d24-8cb4-063bc8736f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c95bb0-07e9-4d24-8cb4-063bc8736f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40', 'volume_name': 'volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a8c594-843e-4810-94ae-7dc388e848da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a8c594-843e-4810-94ae-7dc388e848da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456c00c5-fced-4f53-a0bf-ea42a4f15623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Volume 62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40', 'volume_size': 1} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-983757326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807fc99c87ea4840a0dbacbec7dc3b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:49:10Z,use_quota=True,user_id='81a47cca212341d98a361f84ea051c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Creating volume 62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:49:10 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:10 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 1073741824 Sep 11 13:49:10 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:10 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:49:10 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:10 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.331s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 8 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:49:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:49:11 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 1073741824" returned: 0 in 0.570s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:11 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 Sep 11 13:49:11 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:11 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456c00c5-fced-4f53-a0bf-ea42a4f15623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013872fd-8c57-4136-81d2-b908a099d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:11 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Volume volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 (62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40): created successfully Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013872fd-8c57-4136-81d2-b908a099d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Flow 'volume_create_manager' (27481cb0-99b4-490f-b758-56835ffd32a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:49:11 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-30644613-11c6-4124-ae45-64a7e5a73501 tempest-ServersNegativeTestJSON-1086256999 None] Created volume successfully. Sep 11 13:49:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "cinder-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:49:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:49:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "cinder-quobyte-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:49:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-quobyte-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:49:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f103c78-30d0-4d42-be31-9e0415f187c8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:49:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:14 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 Sep 11 13:49:14 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:15 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40" returned: 0 in 0.491s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:15 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40 Sep 11 13:49:15 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:15 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-quobyte-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40" released by "delete_volume" :: held 0.814s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Created reservations ['c6e75e07-a715-4381-a6dc-456067ccb5dc', 'b74c2727-1672-4e71-88b5-9021e71dad92', 'affab6d6-50bf-4aa0-b127-3b8e719f0949', '3ba32f6c-8f91-4901-a44a-8131201c1a69'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:15 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:49:15 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "cinder-b6b0c5bf-50e6-4048-9c96-efcb140a3784-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-b6b0c5bf-50e6-4048-9c96-efcb140a3784-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "cinder-quobyte-b6b0c5bf-50e6-4048-9c96-efcb140a3784" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-quobyte-b6b0c5bf-50e6-4048-9c96-efcb140a3784" acquired by "delete_volume" :: waited 0.042s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e92824-c353-41fc-adf3-e21a98ad6185]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:49:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:16 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.457s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:49:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Deleted volume successfully. Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-10ad9767-1555-4b45-adb6-988fa03be1c7 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-62a7f6a8-a4c1-4f91-aadb-522fb1e9bc40-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:49:16 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 Sep 11 13:49:16 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:16 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784" returned: 0 in 0.461s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:16 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784 Sep 11 13:49:16 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:16 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b6b0c5bf-50e6-4048-9c96-efcb140a3784" returned: 0 in 0.345s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-quobyte-b6b0c5bf-50e6-4048-9c96-efcb140a3784" released by "delete_volume" :: held 0.860s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Created reservations ['d65a17b4-8334-4219-a089-03130461ba13', '99084f69-785b-48b4-93d5-32f92bc43d13', '55c7b30d-48b6-45cd-965e-1a20b3bc2c8c', 'a148d8fd-6ba7-4d6a-b978-457792daa922'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:17 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:49:17 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:17 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:17 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:49:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Deleted volume successfully. Sep 11 13:49:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a10a13ef-6144-424c-9bc4-908be14bc492 tempest-ServersNegativeTestJSON-1086256999 None] Lock "cinder-b6b0c5bf-50e6-4048-9c96-efcb140a3784-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:49:32 devstack cinder-volume[88731]: WARNING py.warnings [req-63a0efbf-9655-4550-bcd2-adec9abe5afa req-0c25e3f0-82bf-409e-8b26-54017ed4c173 tempest-TaggedAttachmentsTest-484817100 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 11 13:49:32 devstack cinder-volume[88731]: .first() Sep 11 13:49:32 devstack cinder-volume[88731]: Sep 11 13:49:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-63a0efbf-9655-4550-bcd2-adec9abe5afa req-0c25e3f0-82bf-409e-8b26-54017ed4c173 tempest-TaggedAttachmentsTest-484817100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-63a0efbf-9655-4550-bcd2-adec9abe5afa req-0c25e3f0-82bf-409e-8b26-54017ed4c173 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-63a0efbf-9655-4550-bcd2-adec9abe5afa req-0c25e3f0-82bf-409e-8b26-54017ed4c173 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-63a0efbf-9655-4550-bcd2-adec9abe5afa req-0c25e3f0-82bf-409e-8b26-54017ed4c173 tempest-TaggedAttachmentsTest-484817100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '223b4a90-b24b-416e-83d8-e875abdba3c7', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:49:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-63a0efbf-9655-4550-bcd2-adec9abe5afa req-0c25e3f0-82bf-409e-8b26-54017ed4c173 tempest-TaggedAttachmentsTest-484817100 None] attachment_update completed successfully. Sep 11 13:49:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-9d349c2d-0d58-4902-9cf8-440c73903714 req-897f5ce0-8b32-426e-8627-af4962ef7964 tempest-TaggedAttachmentsTest-484817100 None] Terminate volume connection completed successfully. Sep 11 13:49:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-9d349c2d-0d58-4902-9cf8-440c73903714 req-897f5ce0-8b32-426e-8627-af4962ef7964 tempest-TaggedAttachmentsTest-484817100 None] Deleting attachment 223b4a90-b24b-416e-83d8-e875abdba3c7. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:49:51 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=23,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:49:51 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=6 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Flow 'volume_create_manager' (dd6e2507-6a37-42b1-932e-e84502baeeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0909f6e0-2798-4144-9ee4-b3d8723a31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0909f6e0-2798-4144-9ee4-b3d8723a31e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1090670540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4321dd03-d944-4c60-99ac-21938fafe6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dba1f1ae704711874544f13a4cd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:49:57Z,use_quota=True,user_id='eb3be4ee0e11409f99c55176fdde8e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f1f5c9-754a-4550-8ad4-95225b7a7fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f1f5c9-754a-4550-8ad4-95225b7a7fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88e7ee1-2b32-4f67-a2a1-e6a2268f3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88e7ee1-2b32-4f67-a2a1-e6a2268f3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4321dd03-d944-4c60-99ac-21938fafe6db', 'volume_name': 'volume-4321dd03-d944-4c60-99ac-21938fafe6db', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce7d342-55ae-4065-a1a8-e4ad83264c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce7d342-55ae-4065-a1a8-e4ad83264c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caabfdb6-a919-497a-956a-09e3df5af8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:57 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Volume 4321dd03-d944-4c60-99ac-21938fafe6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4321dd03-d944-4c60-99ac-21938fafe6db', 'volume_size': 1} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1090670540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4321dd03-d944-4c60-99ac-21938fafe6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dba1f1ae704711874544f13a4cd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:49:57Z,use_quota=True,user_id='eb3be4ee0e11409f99c55176fdde8e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Creating volume 4321dd03-d944-4c60-99ac-21938fafe6db {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:49:57 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:57 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db 1073741824 Sep 11 13:49:57 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:57 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db 1073741824" returned: 0 in 0.568s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:57 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db Sep 11 13:49:57 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:58 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caabfdb6-a919-497a-956a-09e3df5af8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4321dd03-d944-4c60-99ac-21938fafe6db', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8f144d-f3d3-4531-af14-d71c9184a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:49:58 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Volume volume-4321dd03-d944-4c60-99ac-21938fafe6db (4321dd03-d944-4c60-99ac-21938fafe6db): created successfully Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8f144d-f3d3-4531-af14-d71c9184a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Flow 'volume_create_manager' (dd6e2507-6a37-42b1-932e-e84502baeeff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:49:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-de1a20dc-1e71-413a-80c6-4ea84b908f0b tempest-ServerActionsTestOtherA-68356676 None] Created volume successfully. Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Acquiring lock "cinder-d9ef47c3-4f83-41f4-9cdb-5b70767b077e-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Lock "cinder-d9ef47c3-4f83-41f4-9cdb-5b70767b077e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Acquiring lock "cinder-quobyte-d9ef47c3-4f83-41f4-9cdb-5b70767b077e" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Lock "cinder-quobyte-d9ef47c3-4f83-41f4-9cdb-5b70767b077e" acquired by "delete_volume" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63cef11-4b98-4ee5-a5c3-d3c37aaad705]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:49:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:59 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e Sep 11 13:49:59 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:49:59 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Sep 11 13:49:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e" returned: 0 in 0.786s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:49:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:49:59 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e Sep 11 13:49:59 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:00 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d9ef47c3-4f83-41f4-9cdb-5b70767b077e" returned: 0 in 0.554s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Lock "cinder-quobyte-d9ef47c3-4f83-41f4-9cdb-5b70767b077e" released by "delete_volume" :: held 1.447s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Created reservations ['8bf2b854-6957-4927-9567-13b93eb93d49', '2c8de8e8-536a-421a-85e5-f7060ae9630f', 'e915e52f-d9fd-419e-97a8-8217f729f4df', '1b056a01-969b-499a-895e-880c2c0b37b7'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:00 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:50:00 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:01 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.767s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:01 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:50:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Deleted volume successfully. Sep 11 13:50:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c933641c-90bf-4ad0-8766-3095eca1dfe9 tempest-TaggedAttachmentsTest-484817100 None] Lock "cinder-d9ef47c3-4f83-41f4-9cdb-5b70767b077e-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:50:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Flow 'volume_create_manager' (90ab7425-c23f-4b91-aaaa-4629a597fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c30e78d-4707-48dd-b687-b20fda4096be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c30e78d-4707-48dd-b687-b20fda4096be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-63803275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e26c9-0ed7-4d8b-ba49-5db345c5acec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f911c1d2efa4ddbb8a1d70004d3f9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:06Z,use_quota=True,user_id='4bba6f8d04ab42f78ad1182efe42b604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc9880e-83cb-465e-a9bc-409e5b46dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc9880e-83cb-465e-a9bc-409e5b46dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a70a7d-6e4a-4d2c-bd87-2c8a890843c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a70a7d-6e4a-4d2c-bd87-2c8a890843c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18e26c9-0ed7-4d8b-ba49-5db345c5acec', 'volume_name': 'volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886d06d9-ce24-4c46-a074-3fcba5a7b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886d06d9-ce24-4c46-a074-3fcba5a7b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bac2cbc-e303-43b3-a6d1-328b28322ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Volume b18e26c9-0ed7-4d8b-ba49-5db345c5acec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec', 'volume_size': 1} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-63803275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e26c9-0ed7-4d8b-ba49-5db345c5acec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f911c1d2efa4ddbb8a1d70004d3f9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:06Z,use_quota=True,user_id='4bba6f8d04ab42f78ad1182efe42b604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Creating volume b18e26c9-0ed7-4d8b-ba49-5db345c5acec {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:50:06 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:50:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:06 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec 1073741824 Sep 11 13:50:06 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:07 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec 1073741824" returned: 0 in 1.188s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:07 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec Sep 11 13:50:07 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:08 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec" returned: 0 in 0.731s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bac2cbc-e303-43b3-a6d1-328b28322ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595c670c-8819-4888-b039-566b198411b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Volume volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec (b18e26c9-0ed7-4d8b-ba49-5db345c5acec): created successfully Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595c670c-8819-4888-b039-566b198411b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Flow 'volume_create_manager' (90ab7425-c23f-4b91-aaaa-4629a597fee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8325ad60-e537-4c1d-9351-d52d50580f70 tempest-DeleteServersTestJSON-345431028 None] Created volume successfully. Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:10 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:50:10 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-6c1bc5c7-868c-4012-a8a3-adde63ee6bb6 req-e79cefa3-b9c9-4688-b675-deca9e3a9826 tempest-DeleteServersTestJSON-345431028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-6c1bc5c7-868c-4012-a8a3-adde63ee6bb6 req-e79cefa3-b9c9-4688-b675-deca9e3a9826 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-6c1bc5c7-868c-4012-a8a3-adde63ee6bb6 req-e79cefa3-b9c9-4688-b675-deca9e3a9826 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-6c1bc5c7-868c-4012-a8a3-adde63ee6bb6 req-e79cefa3-b9c9-4688-b675-deca9e3a9826 tempest-DeleteServersTestJSON-345431028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b1e682f-40f8-4c96-8bd5-c84cd32c9fb6', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:50:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-6c1bc5c7-868c-4012-a8a3-adde63ee6bb6 req-e79cefa3-b9c9-4688-b675-deca9e3a9826 tempest-DeleteServersTestJSON-345431028 None] attachment_update completed successfully. Sep 11 13:50:11 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.713s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:50:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-1acdc16a-93a2-4b38-af62-dffd70ad982c req-6086b61b-4e39-4b09-9f18-cdccdf3741a5 tempest-DeleteServersTestJSON-345431028 None] Terminate volume connection completed successfully. Sep 11 13:50:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-1acdc16a-93a2-4b38-af62-dffd70ad982c req-6086b61b-4e39-4b09-9f18-cdccdf3741a5 tempest-DeleteServersTestJSON-345431028 None] Deleting attachment 8b1e682f-40f8-4c96-8bd5-c84cd32c9fb6. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Acquiring lock "cinder-b18e26c9-0ed7-4d8b-ba49-5db345c5acec-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Lock "cinder-b18e26c9-0ed7-4d8b-ba49-5db345c5acec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Acquiring lock "cinder-quobyte-b18e26c9-0ed7-4d8b-ba49-5db345c5acec" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Lock "cinder-quobyte-b18e26c9-0ed7-4d8b-ba49-5db345c5acec" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006978e-e4a8-484f-b3d1-4b1f1722f1de]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:19 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec Sep 11 13:50:19 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:19 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec" returned: 0 in 0.487s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:19 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec Sep 11 13:50:19 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:20 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b18e26c9-0ed7-4d8b-ba49-5db345c5acec" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Lock "cinder-quobyte-b18e26c9-0ed7-4d8b-ba49-5db345c5acec" released by "delete_volume" :: held 0.905s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Created reservations ['f836da3a-ce9f-4587-9ae6-af67fe5be327', 'd782a7a6-4bbe-4d81-a141-961be74b7e01', '4ae2d122-742f-47f5-90ba-0e1eb8486ee7', '4d5de379-551a-455b-a972-b2788f2ba1bd'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:20 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:50:20 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:20 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.441s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:50:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Deleted volume successfully. Sep 11 13:50:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a418e07-580d-43e9-95b1-4f99a446b808 tempest-DeleteServersTestJSON-345431028 None] Lock "cinder-b18e26c9-0ed7-4d8b-ba49-5db345c5acec-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Flow 'volume_create_manager' (12717257-a3ac-4a04-b830-c4be4fec07e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f34933-c0de-40ae-8809-d4e8dac81a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f34933-c0de-40ae-8809-d4e8dac81a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1184331843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed53aeff9d146729a50ffee0cfcb841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:29Z,use_quota=True,user_id='f8e671a6ef6f415da680d1d8c75ce2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cabc169-783f-41cf-8679-35ca9682bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cabc169-783f-41cf-8679-35ca9682bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc94626-a5a7-40d3-9028-aa1c1434f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc94626-a5a7-40d3-9028-aa1c1434f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b', 'volume_name': 'volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43753ca5-ee5a-4ebd-81ec-a97b6a87c3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43753ca5-ee5a-4ebd-81ec-a97b6a87c3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfa7a5d-b4a2-430f-8267-1dd268131061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Volume ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b', 'volume_size': 1} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1184331843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed53aeff9d146729a50ffee0cfcb841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:29Z,use_quota=True,user_id='f8e671a6ef6f415da680d1d8c75ce2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Creating volume ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:50:29 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:50:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:29 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b 1073741824 Sep 11 13:50:29 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:30 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b 1073741824" returned: 0 in 0.506s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:30 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b Sep 11 13:50:30 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:30 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b" returned: 0 in 0.390s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfa7a5d-b4a2-430f-8267-1dd268131061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03581fd-44aa-4e49-906f-c4c2af6a2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:30 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Volume volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b (ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b): created successfully Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03581fd-44aa-4e49-906f-c4c2af6a2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Flow 'volume_create_manager' (12717257-a3ac-4a04-b830-c4be4fec07e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bb72e905-c966-4235-a0fb-8305af9c5a91 tempest-AttachVolumeShelveTestJSON-308242876 None] Created volume successfully. Sep 11 13:50:31 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Flow 'volume_create_manager' (d928c63d-e351-4ae6-893e-54d195b383f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8f1ba-4056-4759-9d49-b93fe2239a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8f1ba-4056-4759-9d49-b93fe2239a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1269574104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298797b6-0ac7-4abd-880d-a95a42fbd6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd12e91f4634bb78736aa5d237e71c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:32Z,use_quota=True,user_id='46ffc8d0fca94d119c0a1bd7b8f7146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df5dad2-a9c6-48a3-be20-5c5a03b4950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df5dad2-a9c6-48a3-be20-5c5a03b4950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a6b039-b3db-4806-a720-efdf4106b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a6b039-b3db-4806-a720-efdf4106b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298797b6-0ac7-4abd-880d-a95a42fbd6d6', 'volume_name': 'volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0defb25-00a1-43c4-9102-db2d4e711186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0defb25-00a1-43c4-9102-db2d4e711186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cefc027-d422-4bdb-ae83-5e5c3a7ebe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Volume 298797b6-0ac7-4abd-880d-a95a42fbd6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6', 'volume_size': 1} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1269574104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298797b6-0ac7-4abd-880d-a95a42fbd6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd12e91f4634bb78736aa5d237e71c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:32Z,use_quota=True,user_id='46ffc8d0fca94d119c0a1bd7b8f7146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Creating volume 298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:50:32 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:32 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 1073741824 Sep 11 13:50:32 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:32 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 1073741824" returned: 0 in 0.612s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:32 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 Sep 11 13:50:32 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:33 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6" returned: 0 in 0.299s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cefc027-d422-4bdb-ae83-5e5c3a7ebe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3188d7-c93e-40f5-8ad3-72d877b6036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Volume volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 (298797b6-0ac7-4abd-880d-a95a42fbd6d6): created successfully Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3188d7-c93e-40f5-8ad3-72d877b6036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Flow 'volume_create_manager' (d928c63d-e351-4ae6-893e-54d195b383f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-98954299-180f-4c13-9eaa-ec8730f3c029 req-54427838-ffbb-4088-bbcf-296e3f26314b tempest-VolumesSnapshotsTestJSON-1055610282 None] Created volume successfully. Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Creating offline snapshot 2c819993-b280-44f0-bbc2-51dffac1536a of volume 298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ca952b-c015-4715-b77c-323430ceb58d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:35 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 Sep 11 13:50:35 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:35 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6" returned: 0 in 0.646s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:35 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a 1G Sep 11 13:50:35 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:36 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a 1G" returned: 0 in 0.445s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:36 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a Sep 11 13:50:36 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:36 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a" returned: 0 in 0.317s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:36 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a is being set with open permissions: ugo+rw Sep 11 13:50:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:36 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a Sep 11 13:50:36 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:36 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:36 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info Sep 11 13:50:36 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:37 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info" returned: 0 in 0.276s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info is being set with open permissions: ugo+rw Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:37 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info Sep 11 13:50:37 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:37 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.info" returned: 0 in 0.348s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:37 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-4857c232-a296-4ac6-97b7-4090a112c7ee req-73e56bbd-a6a2-41a4-ab51-a01bc301b158 tempest-VolumesSnapshotsTestJSON-1055610282 None] Create snapshot completed successfully Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "cinder-2c819993-b280-44f0-bbc2-51dffac1536a-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-2c819993-b280-44f0-bbc2-51dffac1536a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "cinder-quobyte-298797b6-0ac7-4abd-880d-a95a42fbd6d6" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-quobyte-298797b6-0ac7-4abd-880d-a95a42fbd6d6" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "cinder-quobyte-2c819993-b280-44f0-bbc2-51dffac1536a" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-quobyte-2c819993-b280-44f0-bbc2-51dffac1536a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Deleting offline snapshot 2c819993-b280-44f0-bbc2-51dffac1536a of volume 298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] snapshot_file for this snap is: volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571dc09-ab71-485e-b641-74e6f296f505]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:50:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:38 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a Sep 11 13:50:38 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:38 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a" returned: 0 in 0.674s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:50:38 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a27466-447e-4d5b-8e67-1a5d04409920]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:50:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:38 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 Sep 11 13:50:38 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:39 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6" returned: 0 in 0.742s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:39 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a Sep 11 13:50:39 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:40 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a" returned: 0 in 0.688s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:40 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a Sep 11 13:50:40 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:40 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6.2c819993-b280-44f0-bbc2-51dffac1536a" returned: 0 in 0.517s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-quobyte-2c819993-b280-44f0-bbc2-51dffac1536a" released by "_delete_snapshot" :: held 2.802s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-quobyte-298797b6-0ac7-4abd-880d-a95a42fbd6d6" released by "delete_snapshot" :: held 2.849s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:40 devstack cinder-volume[88731]: WARNING cinder.quota [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG cinder.quota [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Created reservations ['53b08750-9830-4783-b07c-36e7552ad1ec', '6ce88a15-db45-4f34-b020-820d9af3ddec', '2e0e72c1-2e4b-4e46-a23a-7eb2e681803e', '58aa9c4c-353e-42f1-8f45-bb713063bad6'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:50:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Delete snapshot completed successfully. Sep 11 13:50:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-a0a3e9b0-1512-4e2e-8af5-644ab3988acf req-5abefafc-6473-42f3-94fc-8125d75b829a tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-2c819993-b280-44f0-bbc2-51dffac1536a-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "cinder-298797b6-0ac7-4abd-880d-a95a42fbd6d6-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-298797b6-0ac7-4abd-880d-a95a42fbd6d6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "cinder-quobyte-298797b6-0ac7-4abd-880d-a95a42fbd6d6" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-quobyte-298797b6-0ac7-4abd-880d-a95a42fbd6d6" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf0a2a-c189-4e2a-bb0b-bd5e53e789c2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:42 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 Sep 11 13:50:42 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:42 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6" returned: 0 in 0.462s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:43 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6 Sep 11 13:50:43 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:43 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-298797b6-0ac7-4abd-880d-a95a42fbd6d6" returned: 0 in 0.443s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-quobyte-298797b6-0ac7-4abd-880d-a95a42fbd6d6" released by "delete_volume" :: held 0.978s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG cinder.quota [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Created reservations ['2ca2923d-9d26-4aa0-9576-3dd2d8889263', 'c4eba95c-ae63-45c8-9bda-793cc2468c23', '0e0ed559-7ca0-4965-8837-928632431342', 'a5a6ff64-2e18-4b11-a14d-6def9e04a42a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:43 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:50:43 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:44 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.570s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:44 devstack cinder-volume[88731]: DEBUG cinder.manager [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:50:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Deleted volume successfully. Sep 11 13:50:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-b0e5d1d3-fdeb-422f-aa06-a60579b984ec req-c87bc2ed-e3a6-4a37-bd19-0cb3f32b4c81 tempest-VolumesSnapshotsTestJSON-1055610282 None] Lock "cinder-298797b6-0ac7-4abd-880d-a95a42fbd6d6-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:50:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98ff1124-a349-4baa-89b6-a9037b753d23 req-d40f956e-3dd9-452d-ac73-6e1a99eda987 tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98ff1124-a349-4baa-89b6-a9037b753d23 req-d40f956e-3dd9-452d-ac73-6e1a99eda987 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-98ff1124-a349-4baa-89b6-a9037b753d23 req-d40f956e-3dd9-452d-ac73-6e1a99eda987 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-98ff1124-a349-4baa-89b6-a9037b753d23 req-d40f956e-3dd9-452d-ac73-6e1a99eda987 tempest-ServerActionsTestOtherA-68356676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-4321dd03-d944-4c60-99ac-21938fafe6db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45f1a6b5-be54-4675-b623-0b823507ad46', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:50:45 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-98ff1124-a349-4baa-89b6-a9037b753d23 req-d40f956e-3dd9-452d-ac73-6e1a99eda987 tempest-ServerActionsTestOtherA-68356676 None] attachment_update completed successfully. Sep 11 13:50:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-7b2d8963-1797-4926-907d-a3bd7e473c75 req-ed1fbc4d-a935-4cc4-a7ae-0f4ba284ba11 tempest-AttachVolumeShelveTestJSON-308242876 None] No connector for attachment 699c4d6f-4c65-4d5f-82cb-3ab36cc5a02b; skipping storage backend terminate_connection call. {{(pid=88731) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 11 13:50:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-7b2d8963-1797-4926-907d-a3bd7e473c75 req-ed1fbc4d-a935-4cc4-a7ae-0f4ba284ba11 tempest-AttachVolumeShelveTestJSON-308242876 None] Deleting attachment 699c4d6f-4c65-4d5f-82cb-3ab36cc5a02b. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:50:53 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=46,cinder:SELECT=44,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:50:53 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=52,cinder:UPDATE=46,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:50:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f2f61929-631b-4559-898e-2c37d18feeeb req-df6c8e4f-be4b-40df-a5b5-b92b220b1254 tempest-ServerActionsTestOtherA-68356676 None] Terminate volume connection completed successfully. Sep 11 13:50:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f2f61929-631b-4559-898e-2c37d18feeeb req-df6c8e4f-be4b-40df-a5b5-b92b220b1254 tempest-ServerActionsTestOtherA-68356676 None] Deleting attachment 45f1a6b5-be54-4675-b623-0b823507ad46. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:50:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f2f61929-631b-4559-898e-2c37d18feeeb req-61e8ee70-1b4a-46ab-8e93-e23c90a3d211 tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f2f61929-631b-4559-898e-2c37d18feeeb req-61e8ee70-1b4a-46ab-8e93-e23c90a3d211 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f2f61929-631b-4559-898e-2c37d18feeeb req-61e8ee70-1b4a-46ab-8e93-e23c90a3d211 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f2f61929-631b-4559-898e-2c37d18feeeb req-61e8ee70-1b4a-46ab-8e93-e23c90a3d211 tempest-ServerActionsTestOtherA-68356676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-4321dd03-d944-4c60-99ac-21938fafe6db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0b59eba-8c0b-428a-ab52-bf285525c8a1', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:50:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f2f61929-631b-4559-898e-2c37d18feeeb req-61e8ee70-1b4a-46ab-8e93-e23c90a3d211 tempest-ServerActionsTestOtherA-68356676 None] attachment_update completed successfully. Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Flow 'volume_create_manager' (853468ba-f8dc-4d99-ab88-f32004aa27fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b6615-d767-4f22-a6f2-ddc990c1eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b6615-d767-4f22-a6f2-ddc990c1eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1312386174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09252520b4244c9a8c1cbade98ccb534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:55Z,use_quota=True,user_id='f596620cddc342428c36ee0d0bd28df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1f736f-3fa7-4b3b-9af0-f8b0af183930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1f736f-3fa7-4b3b-9af0-f8b0af183930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c545dbed-2e0e-4d4b-9173-c5a9786ab4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c545dbed-2e0e-4d4b-9173-c5a9786ab4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8', 'volume_name': 'volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2687f2-9972-4f7e-adc2-15a129a8615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2687f2-9972-4f7e-adc2-15a129a8615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb3f800-2f99-4b21-a09e-ea5b0ed2995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Volume aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8', 'volume_size': 1} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1312386174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09252520b4244c9a8c1cbade98ccb534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:50:55Z,use_quota=True,user_id='f596620cddc342428c36ee0d0bd28df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Creating volume aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:50:55 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:50:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:55 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 1073741824 Sep 11 13:50:55 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:56 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 1073741824" returned: 0 in 0.584s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:50:56 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 Sep 11 13:50:56 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:50:56 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Sep 11 13:50:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8" returned: 0 in 0.519s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:50:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:50:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:50:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb3f800-2f99-4b21-a09e-ea5b0ed2995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cc217b-13ca-45f7-bcaa-270002481d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:57 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Volume volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 (aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8): created successfully Sep 11 13:50:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cc217b-13ca-45f7-bcaa-270002481d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Flow 'volume_create_manager' (853468ba-f8dc-4d99-ab88-f32004aa27fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-00d597de-4459-43de-ac1b-b1c4c06ed619 tempest-VolumesTestJSON-383169298 None] Created volume successfully. Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Flow 'volume_create_manager' (c5365155-fef0-450c-ae47-59a64bc7c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a55e3f0-ec55-4cd8-8789-dd21f63f2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a55e3f0-ec55-4cd8-8789-dd21f63f2889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723925549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c942d9-d907-414d-8089-7100c351d55c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09252520b4244c9a8c1cbade98ccb534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:00Z,use_quota=True,user_id='f596620cddc342428c36ee0d0bd28df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4826b8e3-4e54-450b-84e2-b4089404378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4826b8e3-4e54-450b-84e2-b4089404378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52ff7d8-807d-4940-84f8-58967384277c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52ff7d8-807d-4940-84f8-58967384277c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c942d9-d907-414d-8089-7100c351d55c', 'volume_name': 'volume-b9c942d9-d907-414d-8089-7100c351d55c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a675383-387a-4f8b-ad76-445ac15ea2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a675383-387a-4f8b-ad76-445ac15ea2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9250a700-61eb-4464-abeb-6bdd2ee93146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:50:59 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Volume b9c942d9-d907-414d-8089-7100c351d55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c942d9-d907-414d-8089-7100c351d55c', 'volume_size': 1} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723925549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c942d9-d907-414d-8089-7100c351d55c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09252520b4244c9a8c1cbade98ccb534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:00Z,use_quota=True,user_id='f596620cddc342428c36ee0d0bd28df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Creating volume b9c942d9-d907-414d-8089-7100c351d55c {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:50:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:00 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:00 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c 1073741824 Sep 11 13:51:00 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:01 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c 1073741824" returned: 0 in 1.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:01 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c Sep 11 13:51:01 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:02 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c" returned: 0 in 0.832s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9250a700-61eb-4464-abeb-6bdd2ee93146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c942d9-d907-414d-8089-7100c351d55c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fd1771-d990-49a5-b6f4-3be4726aa3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:02 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Volume volume-b9c942d9-d907-414d-8089-7100c351d55c (b9c942d9-d907-414d-8089-7100c351d55c): created successfully Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fd1771-d990-49a5-b6f4-3be4726aa3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Flow 'volume_create_manager' (c5365155-fef0-450c-ae47-59a64bc7c562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9051a54d-a93a-485a-b377-4d12a09e7a75 tempest-VolumesTestJSON-383169298 None] Created volume successfully. Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Flow 'volume_create_manager' (ded8732f-7a76-480c-a3fc-931ef6cef33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7e69fb-ae3a-431c-ab23-f00e6d6636b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7e69fb-ae3a-431c-ab23-f00e6d6636b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-928541261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbffe45e-674b-4f39-9b0c-8831fd586ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de6a14f46599408ba878150201ba6af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:03Z,use_quota=True,user_id='324108c652a74ed2a3c9fd0ea891a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810f024a-c2ae-4f86-aae7-5b81627b078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810f024a-c2ae-4f86-aae7-5b81627b078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e38d29-9320-4302-ae07-bfa0fba53491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e38d29-9320-4302-ae07-bfa0fba53491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbffe45e-674b-4f39-9b0c-8831fd586ba3', 'volume_name': 'volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b25c562-99cd-45ad-b1bc-69bf9afc6193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b25c562-99cd-45ad-b1bc-69bf9afc6193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c921e050-ba8a-40f2-9646-97e4465cfbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Volume bbffe45e-674b-4f39-9b0c-8831fd586ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3', 'volume_size': 1} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-928541261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbffe45e-674b-4f39-9b0c-8831fd586ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de6a14f46599408ba878150201ba6af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:03Z,use_quota=True,user_id='324108c652a74ed2a3c9fd0ea891a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Creating volume bbffe45e-674b-4f39-9b0c-8831fd586ba3 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:03 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:03 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 1073741824 Sep 11 13:51:03 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Flow 'volume_create_manager' (0aaece8a-67ff-47cd-8785-f09ad2494ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fb28cf-6319-4932-be74-a6f4b4e22f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:04 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 1073741824" returned: 0 in 1.061s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fb28cf-6319-4932-be74-a6f4b4e22f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648456391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f353421-d071-4c93-afaf-27e5886f7e67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09252520b4244c9a8c1cbade98ccb534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:04Z,use_quota=True,user_id='f596620cddc342428c36ee0d0bd28df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b8b952-a7a0-41c6-9b8f-83a971e02c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b8b952-a7a0-41c6-9b8f-83a971e02c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5bbb56-745f-461e-8fad-cc18015d94df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5bbb56-745f-461e-8fad-cc18015d94df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f353421-d071-4c93-afaf-27e5886f7e67', 'volume_name': 'volume-7f353421-d071-4c93-afaf-27e5886f7e67', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b901532-9548-4426-936e-177b08c1b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b901532-9548-4426-936e-177b08c1b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081aa65b-e0e5-4898-9d7f-c7191e1cdfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Volume 7f353421-d071-4c93-afaf-27e5886f7e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f353421-d071-4c93-afaf-27e5886f7e67', 'volume_size': 1} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:04 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 Sep 11 13:51:04 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:05 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3" returned: 0 in 0.330s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648456391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f353421-d071-4c93-afaf-27e5886f7e67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09252520b4244c9a8c1cbade98ccb534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:04Z,use_quota=True,user_id='f596620cddc342428c36ee0d0bd28df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Creating volume 7f353421-d071-4c93-afaf-27e5886f7e67 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c921e050-ba8a-40f2-9646-97e4465cfbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:05 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 1073741824 Sep 11 13:51:05 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6da031-5c57-42bd-ab62-062607d5a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Volume volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 (bbffe45e-674b-4f39-9b0c-8831fd586ba3): created successfully Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6da031-5c57-42bd-ab62-062607d5a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Flow 'volume_create_manager' (ded8732f-7a76-480c-a3fc-931ef6cef33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-454e0d5f-28be-4a15-9f21-998199d4e5c9 tempest-ServerRescueNegativeTestJSON-407428031 None] Created volume successfully. Sep 11 13:51:05 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 1073741824" returned: 0 in 0.899s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:06 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 Sep 11 13:51:06 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:06 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67" returned: 0 in 0.484s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081aa65b-e0e5-4898-9d7f-c7191e1cdfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f353421-d071-4c93-afaf-27e5886f7e67', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa1e497-88ef-4aba-9e2c-b9f5de15c255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Volume volume-7f353421-d071-4c93-afaf-27e5886f7e67 (7f353421-d071-4c93-afaf-27e5886f7e67): created successfully Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa1e497-88ef-4aba-9e2c-b9f5de15c255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Flow 'volume_create_manager' (0aaece8a-67ff-47cd-8785-f09ad2494ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:06 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-38beebf8-2e84-4dba-9b38-99bad5004c87 tempest-VolumesTestJSON-383169298 None] Created volume successfully. Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:10 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:10 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:11 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Acquiring lock "cinder-7f353421-d071-4c93-afaf-27e5886f7e67-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.670s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 8 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Lock "cinder-7f353421-d071-4c93-afaf-27e5886f7e67-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Acquiring lock "cinder-quobyte-7f353421-d071-4c93-afaf-27e5886f7e67" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Lock "cinder-quobyte-7f353421-d071-4c93-afaf-27e5886f7e67" acquired by "delete_volume" :: waited 0.046s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699e8de-0b06-4fd3-826f-8e9146c4146f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:11 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 Sep 11 13:51:11 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:12 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67" returned: 0 in 0.671s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:12 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67 Sep 11 13:51:12 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:12 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7f353421-d071-4c93-afaf-27e5886f7e67" returned: 0 in 0.453s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Lock "cinder-quobyte-7f353421-d071-4c93-afaf-27e5886f7e67" released by "delete_volume" :: held 1.224s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Created reservations ['9b9f8918-e5b5-458f-a04b-679a6e1a8186', '65c25286-bec6-46ea-a267-db7f922888ad', '1155f135-10f1-46b8-975e-b65879866ce6', '2b75e69d-78c5-44da-a56e-a6f8d572eca3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:12 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:12 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:13 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.436s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Deleted volume successfully. Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-81bf8c63-249c-44a4-b19b-46ed637c4b0b tempest-VolumesTestJSON-383169298 None] Lock "cinder-7f353421-d071-4c93-afaf-27e5886f7e67-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Acquiring lock "cinder-b9c942d9-d907-414d-8089-7100c351d55c-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Lock "cinder-b9c942d9-d907-414d-8089-7100c351d55c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Acquiring lock "cinder-quobyte-b9c942d9-d907-414d-8089-7100c351d55c" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Lock "cinder-quobyte-b9c942d9-d907-414d-8089-7100c351d55c" acquired by "delete_volume" :: waited 0.045s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d67b1a-c146-4f50-852c-ce3fe2a5bbe7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:14 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c Sep 11 13:51:14 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:14 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c" returned: 0 in 0.801s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:14 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c Sep 11 13:51:14 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:15 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9c942d9-d907-414d-8089-7100c351d55c" returned: 0 in 0.421s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Lock "cinder-quobyte-b9c942d9-d907-414d-8089-7100c351d55c" released by "delete_volume" :: held 1.346s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Created reservations ['e67a60ee-91cb-4058-ba13-78630788480e', '017a3873-6fc6-4a0f-8a95-9e498f8b7f9f', 'b6e1c22a-21f6-4ae5-bf3a-2c0dd040a50c', 'b0ffa0ba-b696-4ae6-9038-2f9fe13ac2c7'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:15 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:15 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:15 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.406s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Deleted volume successfully. Sep 11 13:51:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49836fa4-dfd0-44f7-ae61-077c0abc321a tempest-VolumesTestJSON-383169298 None] Lock "cinder-b9c942d9-d907-414d-8089-7100c351d55c-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Acquiring lock "cinder-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Lock "cinder-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Acquiring lock "cinder-quobyte-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Lock "cinder-quobyte-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2045ec-7e99-41a8-99cd-4bfefd4c2e1f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:16 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 Sep 11 13:51:16 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:16 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:16 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8 Sep 11 13:51:16 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:16 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8" returned: 0 in 0.292s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Lock "cinder-quobyte-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8" released by "delete_volume" :: held 0.852s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Created reservations ['50c59d9c-f1b2-436e-acd5-fd0255a04597', '42b96dcd-2d4d-495b-a016-d0ae66c781fb', '9259923f-53bc-462d-baeb-c0cd285b12ca', '61586a9a-35b4-4be3-8a18-34fdb0795f63'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:17 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:17 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:17 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.661s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:17 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Deleted volume successfully. Sep 11 13:51:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4bb8304-1dd2-489d-bc6c-4cce50b27944 tempest-VolumesTestJSON-383169298 None] Lock "cinder-aaa7ffdf-7a14-4dc0-8141-a2dd0e46d5a8-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Acquiring lock "cinder-bbffe45e-674b-4f39-9b0c-8831fd586ba3-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "cinder-bbffe45e-674b-4f39-9b0c-8831fd586ba3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Acquiring lock "cinder-quobyte-bbffe45e-674b-4f39-9b0c-8831fd586ba3" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "cinder-quobyte-bbffe45e-674b-4f39-9b0c-8831fd586ba3" acquired by "delete_volume" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:19 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c50bd8-5a9f-4cdd-8c89-35c2f56c1aa0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:19 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 Sep 11 13:51:19 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:20 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3" returned: 0 in 0.788s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:20 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3 Sep 11 13:51:20 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:20 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bbffe45e-674b-4f39-9b0c-8831fd586ba3" returned: 0 in 0.372s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "cinder-quobyte-bbffe45e-674b-4f39-9b0c-8831fd586ba3" released by "delete_volume" :: held 1.230s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Created reservations ['73cbd522-d733-45c9-a0af-f3790b4a751a', 'c09989ac-44ce-45d6-86be-dc47601d7547', '5b20985d-fe90-4363-9aa9-b24b71e2529e', '5c74c514-6d4a-4adb-b8eb-40b87547fa2d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:20 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:20 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:21 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.475s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:21 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Deleted volume successfully. Sep 11 13:51:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5cbf6da-0fa9-444e-a28a-691bd8416525 tempest-ServerRescueNegativeTestJSON-407428031 None] Lock "cinder-bbffe45e-674b-4f39-9b0c-8831fd586ba3-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92cc67e7-508d-4245-93ae-afbeebdeec67 tempest-BackendsCapabilitiesAdminTestsJSON-488530653 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2129020690918, 'free_capacity_gb': 1773.2129020690918, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 13:51:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-002fcc95-0c2c-42af-b64e-f8216fb0e43e tempest-BackendsCapabilitiesAdminTestsJSON-488530653 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2129020690918, 'free_capacity_gb': 1773.2129020690918, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 13:51:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=37,cinder:UPDATE=52,cinder:INSERT=10,cinder:DELETE=2 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:51:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=33,cinder:UPDATE=40,cinder:DELETE=6,cinder:INSERT=10 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:51:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-8677193f-5b13-4fe4-a240-2e1d0de245cd req-279e4175-7c9e-441a-bf75-b551765691cc tempest-ServerActionsTestOtherA-68356676 None] Terminate volume connection completed successfully. Sep 11 13:51:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-8677193f-5b13-4fe4-a240-2e1d0de245cd req-279e4175-7c9e-441a-bf75-b551765691cc tempest-ServerActionsTestOtherA-68356676 None] Deleting attachment f0b59eba-8c0b-428a-ab52-bf285525c8a1. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:51:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9c4f2eeb-9ff0-4995-a52f-98eed9c5606d tempest-GroupsTest-504114985 None] Group tempest-Group1-368979201: creating Sep 11 13:51:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9c4f2eeb-9ff0-4995-a52f-98eed9c5606d tempest-GroupsTest-504114985 None] Group tempest-Group1-368979201: created successfully Sep 11 13:51:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9c4f2eeb-9ff0-4995-a52f-98eed9c5606d tempest-GroupsTest-504114985 None] Create group completed successfully. Sep 11 13:51:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b979cad7-e41b-41fe-8c86-490cc46b9495 tempest-GroupsTest-504114985 None] Group tempest-Group2-1171946694: creating Sep 11 13:51:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b979cad7-e41b-41fe-8c86-490cc46b9495 tempest-GroupsTest-504114985 None] Group tempest-Group2-1171946694: created successfully Sep 11 13:51:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b979cad7-e41b-41fe-8c86-490cc46b9495 tempest-GroupsTest-504114985 None] Create group completed successfully. Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Flow 'volume_create_manager' (a1f7db8a-c5d6-48cb-b784-a5b3c99078d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27029a91-396b-45e9-ac12-a1699676b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27029a91-396b-45e9-ac12-a1699676b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-691976320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71e06c7f-d3b0-4ef0-9154-317c1e484415,host='devstack@QuobyteHD#QuobyteHD',id=cee0a6fe-0f04-4078-b6eb-5b34f3303456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8a039cf974feca61c4cc0566bd2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:46Z,use_quota=True,user_id='7626b706e7e34068b458da4092408d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3095f20-a9c3-4eb6-a7ff-b17e6001eef5),volume_type_id=a3095f20-a9c3-4eb6-a7ff-b17e6001eef5)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cc1978-1d3c-4bed-bb66-10854440217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cc1978-1d3c-4bed-bb66-10854440217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c45755e-9060-4117-a564-de2a9cb24691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c45755e-9060-4117-a564-de2a9cb24691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee0a6fe-0f04-4078-b6eb-5b34f3303456', 'volume_name': 'volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c025207c-24d1-47e8-81d5-6dcb73ebd7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c025207c-24d1-47e8-81d5-6dcb73ebd7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc2d710-3848-4462-89dc-27c50d4564b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:46 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Volume cee0a6fe-0f04-4078-b6eb-5b34f3303456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456', 'volume_size': 1} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71e06c7f-d3b0-4ef0-9154-317c1e484415,created_at=2026-09-11T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-691976320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71e06c7f-d3b0-4ef0-9154-317c1e484415,host='devstack@QuobyteHD#QuobyteHD',id=cee0a6fe-0f04-4078-b6eb-5b34f3303456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8a039cf974feca61c4cc0566bd2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:46Z,use_quota=True,user_id='7626b706e7e34068b458da4092408d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3095f20-a9c3-4eb6-a7ff-b17e6001eef5),volume_type_id=a3095f20-a9c3-4eb6-a7ff-b17e6001eef5)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Creating volume cee0a6fe-0f04-4078-b6eb-5b34f3303456 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:46 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:46 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 1073741824 Sep 11 13:51:46 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:46 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 1073741824" returned: 0 in 0.509s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:46 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 Sep 11 13:51:46 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:46 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456" returned: 0 in 0.298s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc2d710-3848-4462-89dc-27c50d4564b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235bc5f5-1e0d-4b0f-9fd4-6aca8ade504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:46 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Volume volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 (cee0a6fe-0f04-4078-b6eb-5b34f3303456): created successfully Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235bc5f5-1e0d-4b0f-9fd4-6aca8ade504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Flow 'volume_create_manager' (a1f7db8a-c5d6-48cb-b784-a5b3c99078d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-36e11c40-7f06-4f9a-8142-bcdca8b687a1 tempest-GroupsTest-504114985 None] Created volume successfully. Sep 11 13:51:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Acquiring lock "cinder-quobyte-cee0a6fe-0f04-4078-b6eb-5b34f3303456" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Lock "cinder-quobyte-cee0a6fe-0f04-4078-b6eb-5b34f3303456" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:47 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c93c76d-e708-4d84-bbc0-07af571c806c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:48 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 Sep 11 13:51:48 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:48 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456" returned: 0 in 0.439s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:48 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456 Sep 11 13:51:48 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Flow 'volume_create_manager' (c0c3f683-872f-4b72-8086-cc93b5b639ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7275c261-c8ca-4e90-ac06-92ad14ec4bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7275c261-c8ca-4e90-ac06-92ad14ec4bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-32465642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dba1f1ae704711874544f13a4cd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:48Z,use_quota=True,user_id='eb3be4ee0e11409f99c55176fdde8e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01700409-4dea-49a6-8864-a36d36be7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01700409-4dea-49a6-8864-a36d36be7b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e05e8e2-c6a5-4f2c-9275-152a0e3c67e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 13:51:48 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cee0a6fe-0f04-4078-b6eb-5b34f3303456" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Lock "cinder-quobyte-cee0a6fe-0f04-4078-b6eb-5b34f3303456" released by "delete_volume" :: held 0.752s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Created reservations ['717c1446-4556-4722-9b61-2cc4ef0f378a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:48 devstack cinder-volume[88731]: WARNING cinder.quota [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1583210984 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1583210984, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:51:48 devstack cinder-volume[88731]: WARNING cinder.quota [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1583210984 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1583210984, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Created reservations ['2c8db344-d152-4fb4-8128-6e8b83fc7da1', '922fbcab-309d-4a8f-912a-e4110f1c6c6b', '21f209a7-503e-414a-9767-6be915cc65fc', 'cc509e9d-166a-455a-b254-fd30b889c970'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:48 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:48 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:49 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.350s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c2c2a771-183a-4704-b9da-d2a96fcc05e3 tempest-GroupsTest-504114985 None] Delete group completed successfully. Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e05e8e2-c6a5-4f2c-9275-152a0e3c67e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe', 'volume_name': 'volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2013fd1-f7e6-4528-b89a-597a45b40ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2013fd1-f7e6-4528-b89a-597a45b40ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b473b-e1f5-4eac-89f3-4c3cd1e94d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Volume 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Trying to clone 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Created reservations ['7b61a53a-a14e-4ded-ad7e-4c4ab766e4d1'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:49 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:49 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:49 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 13:51:49 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Image download 20.69 MB at 20.69 MB/s Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1008e0-5ca1-4e3d-8a53-97d5a9766027]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:50 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.493s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b58f5f68-9618-4bf4-9470-1cfc861966a6 tempest-GroupsTest-504114985 None] Delete group completed successfully. Sep 11 13:51:50 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD Sep 11 13:51:50 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:50 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c is fetched for user eb3be4ee0e11409f99c55176fdde8e16. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faee2e7-1963-4a94-8b30-5a36bb1d8777]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:50 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD Sep 11 13:51:50 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:51 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-32465642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dba1f1ae704711874544f13a4cd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:48Z,use_quota=True,user_id='eb3be4ee0e11409f99c55176fdde8e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Creating volume 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:51 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:51 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe 1073741824 Sep 11 13:51:51 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a1658132-7b49-4049-96dc-321730ab07f7 tempest-GroupsTest-504114985 None] Group tempest-GroupsTest-Group-540093204: creating Sep 11 13:51:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a1658132-7b49-4049-96dc-321730ab07f7 tempest-GroupsTest-504114985 None] Group tempest-GroupsTest-Group-540093204: created successfully Sep 11 13:51:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a1658132-7b49-4049-96dc-321730ab07f7 tempest-GroupsTest-504114985 None] Create group completed successfully. Sep 11 13:51:51 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe 1073741824" returned: 0 in 0.610s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:51 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe Sep 11 13:51:51 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:52 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" returned: 0 in 0.338s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Attempting download of 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b5c59-b82d-4ede-9984-02140388569d]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:52 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j Sep 11 13:51:52 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:52 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j" returned: 0 in 0.453s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:52 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j Sep 11 13:51:52 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Flow 'volume_create_manager' (bcc2496a-b1d7-4352-867d-d850a7c49162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07469677-9a11-432f-9897-2ed22cf4ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07469677-9a11-432f-9897-2ed22cf4ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-369096633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6974cc78-6a94-4686-b5cf-e1f2f1891493,host='devstack@QuobyteHD#QuobyteHD',id=aebf44f1-bc1c-4348-896b-43e9ee576824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8a039cf974feca61c4cc0566bd2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:53Z,use_quota=True,user_id='7626b706e7e34068b458da4092408d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44dddfd-30c2-4649-aa07-2e74035b1ebe),volume_type_id=b44dddfd-30c2-4649-aa07-2e74035b1ebe)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3017f-415d-4f66-a44e-80c365ce95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3017f-415d-4f66-a44e-80c365ce95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba95a2-5b82-47c7-8a05-9dcb92a5f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba95a2-5b82-47c7-8a05-9dcb92a5f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebf44f1-bc1c-4348-896b-43e9ee576824', 'volume_name': 'volume-aebf44f1-bc1c-4348-896b-43e9ee576824', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8caf1d8-1870-467a-a9b7-0a4a8acd8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8caf1d8-1870-467a-a9b7-0a4a8acd8fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965b02f6-fc24-4887-8c83-225420d059c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Volume aebf44f1-bc1c-4348-896b-43e9ee576824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebf44f1-bc1c-4348-896b-43e9ee576824', 'volume_size': 1} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6974cc78-6a94-4686-b5cf-e1f2f1891493,created_at=2026-09-11T11:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-369096633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6974cc78-6a94-4686-b5cf-e1f2f1891493,host='devstack@QuobyteHD#QuobyteHD',id=aebf44f1-bc1c-4348-896b-43e9ee576824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8a039cf974feca61c4cc0566bd2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:53Z,use_quota=True,user_id='7626b706e7e34068b458da4092408d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44dddfd-30c2-4649-aa07-2e74035b1ebe),volume_type_id=b44dddfd-30c2-4649-aa07-2e74035b1ebe)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Creating volume aebf44f1-bc1c-4348-896b-43e9ee576824 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:53 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:53 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j" returned: 1 in 0.642s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_r2t_bg4j' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20590909-c955-4245-bcde-93912209535e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:53 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 1073741824 Sep 11 13:51:53 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:53 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD Sep 11 13:51:53 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:53 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] 6b854647-c6a5-4221-a6fc-d6c3dbc5707c was qcow2, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:53 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe Sep 11 13:51:53 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:53 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 1073741824" returned: 0 in 0.617s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:53 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 Sep 11 13:51:53 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Acquiring lock "cinder-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "cinder-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:54 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Acquiring lock "cinder-quobyte-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824" returned: 0 in 0.365s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965b02f6-fc24-4887-8c83-225420d059c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebf44f1-bc1c-4348-896b-43e9ee576824', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93958847-1e7b-4ff3-bd37-89d4e11d3767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "cinder-quobyte-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b" acquired by "delete_volume" :: waited 0.055s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e38b8-ea3f-4883-aad4-64a4e6d3c80c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Volume volume-aebf44f1-bc1c-4348-896b-43e9ee576824 (aebf44f1-bc1c-4348-896b-43e9ee576824): created successfully Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93958847-1e7b-4ff3-bd37-89d4e11d3767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Flow 'volume_create_manager' (bcc2496a-b1d7-4352-867d-d850a7c49162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-49bfcdf0-6746-4502-945b-4f7f5cc3b44e tempest-GroupsTest-504114985 None] Created volume successfully. Sep 11 13:51:54 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b Sep 11 13:51:54 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:54 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b" returned: 0 in 0.531s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:54 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b Sep 11 13:51:54 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:55 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b" returned: 0 in 0.464s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "cinder-quobyte-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b" released by "delete_volume" :: held 1.060s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Created reservations ['3205f8b9-d7cb-469c-8e2a-847339ea8c69', 'e411918c-eba3-46be-8f8e-11f082fdeaae', 'e7334227-3012-43c4-b172-b30ea004354e', '5015f842-d1aa-423b-b785-0434870d6cbc'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:55 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:51:55 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:55 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:51:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Deleted volume successfully. Sep 11 13:51:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd9f5638-b32d-491d-970a-7cdc6e42544b tempest-AttachVolumeShelveTestJSON-308242876 None] Lock "cinder-ef44eeb9-f12c-4a2b-9514-0a0a464c1e9b-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:51:56 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" returned: 0 in 2.357s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ggycep83devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:51:56 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Converted 112.00 MB image at 47.50 MB/s Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:56 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe 1G Sep 11 13:51:56 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Flow 'volume_create_manager' (a5d95e67-9387-4c95-b3f8-f846d7b18a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53014b22-cc9e-474c-a142-d24fd32bfa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53014b22-cc9e-474c-a142-d24fd32bfa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729290770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6974cc78-6a94-4686-b5cf-e1f2f1891493,host='devstack@QuobyteHD#QuobyteHD',id=aed89f3a-3cad-48c9-ace6-7dbceac5fb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8a039cf974feca61c4cc0566bd2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:56Z,use_quota=True,user_id='7626b706e7e34068b458da4092408d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44dddfd-30c2-4649-aa07-2e74035b1ebe),volume_type_id=b44dddfd-30c2-4649-aa07-2e74035b1ebe)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02c75ab-2810-448f-b12b-9bb6a6e5243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02c75ab-2810-448f-b12b-9bb6a6e5243e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e808de8-0606-41d3-ab3e-5a13fde9a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e808de8-0606-41d3-ab3e-5a13fde9a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed89f3a-3cad-48c9-ace6-7dbceac5fb51', 'volume_name': 'volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b448ec-d7d1-4e5a-a4ff-687d109cd88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b448ec-d7d1-4e5a-a4ff-687d109cd88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc11c02-e064-4acb-a508-39a4eaeed3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Volume aed89f3a-3cad-48c9-ace6-7dbceac5fb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51', 'volume_size': 1} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6974cc78-6a94-4686-b5cf-e1f2f1891493,created_at=2026-09-11T11:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729290770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6974cc78-6a94-4686-b5cf-e1f2f1891493,host='devstack@QuobyteHD#QuobyteHD',id=aed89f3a-3cad-48c9-ace6-7dbceac5fb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8a039cf974feca61c4cc0566bd2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:51:56Z,use_quota=True,user_id='7626b706e7e34068b458da4092408d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44dddfd-30c2-4649-aa07-2e74035b1ebe),volume_type_id=b44dddfd-30c2-4649-aa07-2e74035b1ebe)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Creating volume aed89f3a-3cad-48c9-ace6-7dbceac5fb51 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:51:56 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:56 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 1073741824 Sep 11 13:51:56 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:56 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe 1G" returned: 0 in 0.423s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Downloaded image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c for user eb3be4ee0e11409f99c55176fdde8e16 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Marking volume 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Copying metadata from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c to 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Creating volume glance metadata for volume 3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe backed by image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b473b-e1f5-4eac-89f3-4c3cd1e94d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96243d6b-bfc3-4315-8387-bb4be2a37227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Volume volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe (3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe): created successfully Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96243d6b-bfc3-4315-8387-bb4be2a37227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Flow 'volume_create_manager' (c0c3f683-872f-4b72-8086-cc93b5b639ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9824732d-c6ac-45bb-8a49-8034f492d895 tempest-ServerActionsTestOtherA-68356676 None] Created volume successfully. Sep 11 13:51:56 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 1073741824" returned: 0 in 0.553s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:51:57 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 Sep 11 13:51:57 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:51:57 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51" returned: 0 in 0.311s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc11c02-e064-4acb-a508-39a4eaeed3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2e41fe-c5aa-48c5-8172-687f2c3f691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:51:57 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Volume volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 (aed89f3a-3cad-48c9-ace6-7dbceac5fb51): created successfully Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2e41fe-c5aa-48c5-8172-687f2c3f691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:51:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Flow 'volume_create_manager' (a5d95e67-9387-4c95-b3f8-f846d7b18a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:51:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d101467b-ac17-4500-9de4-302a8ef28055 tempest-GroupsTest-504114985 None] Created volume successfully. Sep 11 13:51:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b65f52e3-f667-447b-854d-6d2153550220 tempest-GroupsTest-504114985 None] Update group completed successfully. Sep 11 13:52:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6368a7c4-e389-4c59-8378-8d4899983963 tempest-GroupsTest-504114985 None] Update group completed successfully. Sep 11 13:52:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-7fac8bb0-5d4a-4e86-933b-fc6270a21387 req-7a8650ab-d263-4c66-80dd-5e5a1934e6cb tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-7fac8bb0-5d4a-4e86-933b-fc6270a21387 req-7a8650ab-d263-4c66-80dd-5e5a1934e6cb tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-7fac8bb0-5d4a-4e86-933b-fc6270a21387 req-7a8650ab-d263-4c66-80dd-5e5a1934e6cb tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-7fac8bb0-5d4a-4e86-933b-fc6270a21387 req-7a8650ab-d263-4c66-80dd-5e5a1934e6cb tempest-ServerActionsTestOtherA-68356676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c05cba5-e942-456a-b985-5ac814606b2f', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:52:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-7fac8bb0-5d4a-4e86-933b-fc6270a21387 req-7a8650ab-d263-4c66-80dd-5e5a1934e6cb tempest-ServerActionsTestOtherA-68356676 None] attachment_update completed successfully. Sep 11 13:52:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Acquiring lock "cinder-quobyte-aebf44f1-bc1c-4348-896b-43e9ee576824" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:52:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Lock "cinder-quobyte-aebf44f1-bc1c-4348-896b-43e9ee576824" acquired by "delete_volume" :: waited 0.043s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:52:02 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f5e3b-b892-4dae-a65e-37993a259249]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:52:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:02 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 Sep 11 13:52:02 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:03 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824" returned: 0 in 0.742s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:03 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824 Sep 11 13:52:03 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:03 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aebf44f1-bc1c-4348-896b-43e9ee576824" returned: 0 in 0.374s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Lock "cinder-quobyte-aebf44f1-bc1c-4348-896b-43e9ee576824" released by "delete_volume" :: held 1.205s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Acquiring lock "cinder-quobyte-aed89f3a-3cad-48c9-ace6-7dbceac5fb51" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Lock "cinder-quobyte-aed89f3a-3cad-48c9-ace6-7dbceac5fb51" acquired by "delete_volume" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef393b-4f70-4894-84d0-d1382a726030]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:52:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:03 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 Sep 11 13:52:03 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:03 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51" returned: 0 in 0.448s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:04 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51 Sep 11 13:52:04 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:04 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aed89f3a-3cad-48c9-ace6-7dbceac5fb51" returned: 0 in 0.288s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Lock "cinder-quobyte-aed89f3a-3cad-48c9-ace6-7dbceac5fb51" released by "delete_volume" :: held 0.799s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Created reservations ['d8e4a64c-329b-4952-adf5-448628dabdeb'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:52:04 devstack cinder-volume[88731]: WARNING cinder.quota [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1000946493 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1000946493, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:52:04 devstack cinder-volume[88731]: WARNING cinder.quota [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1000946493 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1000946493, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Created reservations ['edfb3905-691a-48cd-81c3-1b21cf455f1c', 'ab7c3957-d024-432c-80f1-8a2f86c91265', 'bd92c6d0-593d-40c7-9c98-b821bdb6c426', '6d6df0b6-d4d4-4e43-b8e8-02c6d89b5406'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:52:04 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Created reservations ['589c5b8e-19d5-4fd3-8439-df02ef3dca35', '9e4f6091-4d4f-4135-9093-cdc1c7ef3aff', '30fcf9fb-9809-4d12-8c2f-1c14d304ada9', '0c211c90-b886-42b4-9e1f-05a40f40c184'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:05 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:52:05 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:05 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.524s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:05 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:52:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b6c47426-b211-49d9-9ff7-a8a270961951 tempest-GroupsTest-504114985 None] Delete group completed successfully. Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:10 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:52:10 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:11 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.486s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:52:11 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:52:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:52:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:52:14 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=59,cinder:UPDATE=66,cinder:DELETE=3,cinder:INSERT=21 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:52:15 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=67,cinder:UPDATE=53,cinder:INSERT=15,cinder:DELETE=2 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:52:18 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:52:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Flow 'volume_create_manager' (c43de23d-413c-4595-be0d-3a15388ba655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:52:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d01998a-e3e2-4d01-840c-1c441b265c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d01998a-e3e2-4d01-840c-1c441b265c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2036996612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15f4e8a-519d-4546-8774-1f4df5c02f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a05bfc6acb483eb5c05d1e27af5f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:52:19Z,use_quota=True,user_id='c747a3c3ee9b426f8edcbb436a34336d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab00e639-36ae-4eb6-a7b7-43c27e03037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab00e639-36ae-4eb6-a7b7-43c27e03037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c10938b-6731-4488-a7a9-e486919ff3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c10938b-6731-4488-a7a9-e486919ff3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15f4e8a-519d-4546-8774-1f4df5c02f4d', 'volume_name': 'volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44d4706-271a-4d7e-b1e9-24fe9dc219be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44d4706-271a-4d7e-b1e9-24fe9dc219be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae04866-7610-4520-962f-ed5f3bc18c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:19 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Volume f15f4e8a-519d-4546-8774-1f4df5c02f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d', 'volume_size': 1} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2036996612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15f4e8a-519d-4546-8774-1f4df5c02f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a05bfc6acb483eb5c05d1e27af5f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:52:19Z,use_quota=True,user_id='c747a3c3ee9b426f8edcbb436a34336d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Creating volume f15f4e8a-519d-4546-8774-1f4df5c02f4d {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:52:19 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:19 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d 1073741824 Sep 11 13:52:19 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:19 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d 1073741824" returned: 0 in 0.878s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:20 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d Sep 11 13:52:20 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:20 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d" returned: 0 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae04866-7610-4520-962f-ed5f3bc18c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf6c2e-a23e-4e7b-bab6-b098f27953aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:20 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Volume volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d (f15f4e8a-519d-4546-8774-1f4df5c02f4d): created successfully Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf6c2e-a23e-4e7b-bab6-b098f27953aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Flow 'volume_create_manager' (c43de23d-413c-4595-be0d-3a15388ba655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:52:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5e11faab-7968-4ff9-98d9-55c5c23cbfdc tempest-VolumeQuotasAdminTestJSON-1485395917 None] Created volume successfully. Sep 11 13:52:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "cinder-f15f4e8a-519d-4546-8774-1f4df5c02f4d-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "cinder-f15f4e8a-519d-4546-8774-1f4df5c02f4d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "cinder-quobyte-f15f4e8a-519d-4546-8774-1f4df5c02f4d" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "cinder-quobyte-f15f4e8a-519d-4546-8774-1f4df5c02f4d" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcdc96e-c292-41b0-b13c-b47e0f6fcdd1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:21 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d Sep 11 13:52:21 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:21 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d" returned: 0 in 0.693s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:22 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d Sep 11 13:52:22 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-707d420f-4825-45dd-921a-540c388a609e tempest-ServerActionsTestOtherA-68356676 None] Terminate volume connection completed successfully. Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-707d420f-4825-45dd-921a-540c388a609e tempest-ServerActionsTestOtherA-68356676 None] Deleting attachment 3c05cba5-e942-456a-b985-5ac814606b2f. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:52:22 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f15f4e8a-519d-4546-8774-1f4df5c02f4d" returned: 0 in 0.447s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "cinder-quobyte-f15f4e8a-519d-4546-8774-1f4df5c02f4d" released by "delete_volume" :: held 1.228s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Created reservations ['bec3fdf4-1677-4a15-b2ca-57d0f090e713', '7477686f-5db2-4ab4-8a0d-a004138483e7', '9e7928ef-3257-4887-88fa-a4cae659537c', 'c7130de2-b822-4a00-b0c2-bea0415e5272'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:22 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:52:22 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:22 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.374s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:23 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:52:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Deleted volume successfully. Sep 11 13:52:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-fb3cfc87-2f33-418f-9fdc-c9547195d8a1 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "cinder-f15f4e8a-519d-4546-8774-1f4df5c02f4d-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Flow 'volume_create_manager' (f89cbddf-7154-4d6f-9a36-acda4e4b95ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bc9ad1-f96c-4c85-b15a-23c4e937a966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bc9ad1-f96c-4c85-b15a-23c4e937a966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-886086741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0edad79-61b7-4427-a76a-cede65500b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a05bfc6acb483eb5c05d1e27af5f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:52:24Z,use_quota=True,user_id='c747a3c3ee9b426f8edcbb436a34336d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bd110a-0fe0-45d1-82d7-d58f5b72de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bd110a-0fe0-45d1-82d7-d58f5b72de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edeaba73-de17-4c32-88d5-1c106aeaeb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edeaba73-de17-4c32-88d5-1c106aeaeb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0edad79-61b7-4427-a76a-cede65500b37', 'volume_name': 'volume-f0edad79-61b7-4427-a76a-cede65500b37', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4f2371-889a-4b08-b974-232d99c38230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4f2371-889a-4b08-b974-232d99c38230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bafcf53-31bb-4ca3-8bee-8fa43643425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:24 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Volume f0edad79-61b7-4427-a76a-cede65500b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0edad79-61b7-4427-a76a-cede65500b37', 'volume_size': 1} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-886086741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0edad79-61b7-4427-a76a-cede65500b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a05bfc6acb483eb5c05d1e27af5f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:52:24Z,use_quota=True,user_id='c747a3c3ee9b426f8edcbb436a34336d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Creating volume f0edad79-61b7-4427-a76a-cede65500b37 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:52:24 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:24 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 1073741824 Sep 11 13:52:24 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-03dad895-c890-4b58-84f9-85dadab604a8 tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:24 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 1073741824" returned: 0 in 0.603s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:24 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 Sep 11 13:52:24 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:25 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-03dad895-c890-4b58-84f9-85dadab604a8 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.593s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bafcf53-31bb-4ca3-8bee-8fa43643425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0edad79-61b7-4427-a76a-cede65500b37', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296a3588-9cd3-47e3-858f-ab4b064e6fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-03dad895-c890-4b58-84f9-85dadab604a8 tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Volume volume-f0edad79-61b7-4427-a76a-cede65500b37 (f0edad79-61b7-4427-a76a-cede65500b37): created successfully Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296a3588-9cd3-47e3-858f-ab4b064e6fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Flow 'volume_create_manager' (f89cbddf-7154-4d6f-9a36-acda4e4b95ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:52:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c0d7c2df-2907-4d8a-9d14-ef6e67ca6b97 tempest-VolumeQuotasAdminTestJSON-1485395917 None] Created volume successfully. Sep 11 13:52:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-03dad895-c890-4b58-84f9-85dadab604a8 tempest-ServerActionsTestOtherA-68356676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fed74f8-fab9-43b8-b315-36a72fe7b3b6', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:52:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-181abe24-46c6-42c5-b569-bf7a5103a27a req-03dad895-c890-4b58-84f9-85dadab604a8 tempest-ServerActionsTestOtherA-68356676 None] attachment_update completed successfully. Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Flow 'volume_create_manager' (dd7dedd9-ea01-4ed3-ab83-8ef26fd1ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e63110d-1abd-4bab-9a7c-f35c8eb08aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e63110d-1abd-4bab-9a7c-f35c8eb08aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-38894194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d4737-be50-4007-a36c-131c93c8e6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1e90416eb43aeaef515be261d5dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:52:26Z,use_quota=True,user_id='c4c2088dbb3548489f095e8a2e1a4110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2da4c7-d865-4dd0-a9eb-2f5b13862d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2da4c7-d865-4dd0-a9eb-2f5b13862d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fb9f05-1a32-4f51-8f9c-d40ea72e0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fb9f05-1a32-4f51-8f9c-d40ea72e0753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2d4737-be50-4007-a36c-131c93c8e6ef', 'volume_name': 'volume-dd2d4737-be50-4007-a36c-131c93c8e6ef', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c70a870-eb4c-4059-bca2-9d7130d5f7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c70a870-eb4c-4059-bca2-9d7130d5f7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d191c1-94dd-4016-bf26-5225cf013563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Volume dd2d4737-be50-4007-a36c-131c93c8e6ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2d4737-be50-4007-a36c-131c93c8e6ef', 'volume_size': 1} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-38894194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d4737-be50-4007-a36c-131c93c8e6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1e90416eb43aeaef515be261d5dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:52:26Z,use_quota=True,user_id='c4c2088dbb3548489f095e8a2e1a4110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Creating volume dd2d4737-be50-4007-a36c-131c93c8e6ef {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:52:26 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:52:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:26 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef 1073741824 Sep 11 13:52:26 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ca245cdd-5e40-449b-8a71-b50ce461f7bf tempest-VolumeQuotasAdminTestJSON-2121535141 None] Transfer volume completed successfully. Sep 11 13:52:27 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef 1073741824" returned: 0 in 0.950s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:27 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef Sep 11 13:52:27 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:28 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef" returned: 0 in 0.510s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d191c1-94dd-4016-bf26-5225cf013563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2d4737-be50-4007-a36c-131c93c8e6ef', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f4d14-09fb-4a6a-ba47-82546de7c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:52:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Volume volume-dd2d4737-be50-4007-a36c-131c93c8e6ef (dd2d4737-be50-4007-a36c-131c93c8e6ef): created successfully Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f4d14-09fb-4a6a-ba47-82546de7c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Flow 'volume_create_manager' (dd7dedd9-ea01-4ed3-ab83-8ef26fd1ef09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:52:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-04aab6ed-2ac2-4553-aaa6-8cb955beb429 tempest-AttachVolumeNegativeTest-1005663331 None] Created volume successfully. Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Acquiring lock "cinder-f0edad79-61b7-4427-a76a-cede65500b37-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Lock "cinder-f0edad79-61b7-4427-a76a-cede65500b37-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Acquiring lock "cinder-quobyte-f0edad79-61b7-4427-a76a-cede65500b37" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Lock "cinder-quobyte-f0edad79-61b7-4427-a76a-cede65500b37" acquired by "delete_volume" :: waited 0.047s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931d836-57d5-4e49-9fea-f9204e99a1fc]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:52:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:28 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 Sep 11 13:52:28 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:29 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37" returned: 0 in 0.607s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:29 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37 Sep 11 13:52:29 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:29 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0edad79-61b7-4427-a76a-cede65500b37" returned: 0 in 0.367s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Lock "cinder-quobyte-f0edad79-61b7-4427-a76a-cede65500b37" released by "delete_volume" :: held 1.112s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-68657ab4-a447-4f96-88e1-288f7f633d7f req-0ae28245-1a3d-4ad0-b598-1a3faf0be0e5 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-68657ab4-a447-4f96-88e1-288f7f633d7f req-0ae28245-1a3d-4ad0-b598-1a3faf0be0e5 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Created reservations ['cc1e6b6b-c598-4756-96bf-c7cc4993b990', 'ac5e8c72-26f7-4a87-8743-33fed9cedb93', '4873d57d-77f1-4958-9868-a3210257e132', '50c7b6f6-c52d-4871-a200-fa96c4dcba45'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-68657ab4-a447-4f96-88e1-288f7f633d7f req-0ae28245-1a3d-4ad0-b598-1a3faf0be0e5 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-68657ab4-a447-4f96-88e1-288f7f633d7f req-0ae28245-1a3d-4ad0-b598-1a3faf0be0e5 tempest-AttachVolumeNegativeTest-1005663331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-dd2d4737-be50-4007-a36c-131c93c8e6ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4d1d6e4-67eb-4920-8427-f5730cc09afa', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:52:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:52:29 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:52:29 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:52:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-68657ab4-a447-4f96-88e1-288f7f633d7f req-0ae28245-1a3d-4ad0-b598-1a3faf0be0e5 tempest-AttachVolumeNegativeTest-1005663331 None] attachment_update completed successfully. Sep 11 13:52:30 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 11 13:52:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.370s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:52:30 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:52:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Deleted volume successfully. Sep 11 13:52:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-208dd769-f2ec-4d93-b0b2-3664e231933c tempest-VolumeQuotasAdminTestJSON-1396432944 None] Lock "cinder-f0edad79-61b7-4427-a76a-cede65500b37-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:52:39 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=28,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:52:40 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=33,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:53:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-e5436d25-90a9-439e-8ca1-994a66c421c4 tempest-ServerActionsTestOtherA-68356676 None] Terminate volume connection completed successfully. Sep 11 13:53:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-e5436d25-90a9-439e-8ca1-994a66c421c4 tempest-ServerActionsTestOtherA-68356676 None] Deleting attachment 1fed74f8-fab9-43b8-b315-36a72fe7b3b6. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "cinder-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "cinder-quobyte-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-quobyte-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" acquired by "delete_volume" :: waited 0.042s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98890e8-6631-48d5-b65b-377bed9891a3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:02 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe Sep 11 13:53:02 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:02 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:02 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe Sep 11 13:53:02 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:03 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" returned: 0 in 0.318s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-quobyte-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe" released by "delete_volume" :: held 0.905s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.quota [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Created reservations ['77113573-8f6d-4d5d-8719-09b2d8087aa0', '153716e7-bd62-4d4f-981f-6d1b2e0d1560', 'e55cbeab-d51c-4d84-be5f-74cd247df302', 'abd13cfe-7819-4daf-9224-44c4b53a66b2'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:03 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:03 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "cinder-4321dd03-d944-4c60-99ac-21938fafe6db-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-4321dd03-d944-4c60-99ac-21938fafe6db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "cinder-quobyte-4321dd03-d944-4c60-99ac-21938fafe6db" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-quobyte-4321dd03-d944-4c60-99ac-21938fafe6db" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a410b7-1f5a-45b8-8e99-e52272c45d45]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:03 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.manager [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:03 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Deleted volume successfully. Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-89a9dcc5-a316-49d3-a022-a8d8a8d353fb req-0bc56792-b133-4473-b8d3-ecb6b43e0aed tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-3b4679e7-44fe-4b70-9ce7-e358f6b8b9fe-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:03 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db Sep 11 13:53:03 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:03 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:03 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db Sep 11 13:53:03 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:04 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4321dd03-d944-4c60-99ac-21938fafe6db" returned: 0 in 0.243s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-quobyte-4321dd03-d944-4c60-99ac-21938fafe6db" released by "delete_volume" :: held 0.677s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Created reservations ['244d6f7f-9bef-4f1b-bf67-c8b4f8f56120', 'a1250eef-5bec-47e2-aedc-97f7de3e7abb', 'cf9c9e79-0b9f-4709-9d3f-cdcdbc889a8f', 'fc8fbd78-97bc-4a03-b792-1fd42a605138'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:04 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:04 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:04 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.268s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Deleted volume successfully. Sep 11 13:53:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed928418-bf6e-4a82-a3e9-972d7188d67e tempest-ServerActionsTestOtherA-68356676 None] Lock "cinder-4321dd03-d944-4c60-99ac-21938fafe6db-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Flow 'volume_create_manager' (58c98a43-9f0f-4f89-85bb-3c25d3471201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1d6dc4-201c-4bb0-b849-3b6033131f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1d6dc4-201c-4bb0-b849-3b6033131f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-268002606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732d0978-8bbb-4dff-a4eb-bb4cbf16dc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f408c1beff4b7d8c1dd290d43e7c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:05Z,use_quota=True,user_id='4bdde260bb4a41cd9b616ed9aff178e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a817d8-d0d4-4f16-b50f-f369f4aa932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a817d8-d0d4-4f16-b50f-f369f4aa932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcea61f-ad9c-44de-8e4d-ed7f394d95b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcea61f-ad9c-44de-8e4d-ed7f394d95b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732d0978-8bbb-4dff-a4eb-bb4cbf16dc77', 'volume_name': 'volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1aadcd-b2ca-432f-861e-36627279997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1aadcd-b2ca-432f-861e-36627279997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca5f59e-25c7-4a82-87a6-cabb9ad88b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Volume 732d0978-8bbb-4dff-a4eb-bb4cbf16dc77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77', 'volume_size': 1} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-268002606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732d0978-8bbb-4dff-a4eb-bb4cbf16dc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f408c1beff4b7d8c1dd290d43e7c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:05Z,use_quota=True,user_id='4bdde260bb4a41cd9b616ed9aff178e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Creating volume 732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:53:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:53:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:05 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 1073741824 Sep 11 13:53:05 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:06 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 1073741824" returned: 0 in 0.444s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:06 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 Sep 11 13:53:06 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:06 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" returned: 0 in 0.282s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca5f59e-25c7-4a82-87a6-cabb9ad88b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef15fc-eeaf-4ff1-a01c-83a6293023d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Volume volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 (732d0978-8bbb-4dff-a4eb-bb4cbf16dc77): created successfully Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef15fc-eeaf-4ff1-a01c-83a6293023d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Flow 'volume_create_manager' (58c98a43-9f0f-4f89-85bb-3c25d3471201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:06 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bb121005-915a-4034-a81b-af7c27c1dccf tempest-SnapshotMetadataTestJSON-582954586 None] Created volume successfully. Sep 11 13:53:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Creating offline snapshot 67e0aa78-65b9-4f14-9106-2b5a2bc245e1 of volume 732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:53:07 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[919fa8fa-1270-4c42-8fb2-e0d1acec0241]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:07 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 Sep 11 13:53:07 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:08 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:08 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 1G Sep 11 13:53:08 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:08 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 1G" returned: 0 in 0.531s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:08 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 Sep 11 13:53:08 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:09 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1" returned: 0 in 0.434s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:09 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 is being set with open permissions: ugo+rw Sep 11 13:53:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:09 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 Sep 11 13:53:09 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:09 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1" returned: 0 in 0.300s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:09 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info Sep 11 13:53:09 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:09 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info" returned: 0 in 0.289s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:09 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info is being set with open permissions: ugo+rw Sep 11 13:53:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:09 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info Sep 11 13:53:09 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:10 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.info" returned: 0 in 0.320s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-877238b0-6e3e-4dea-a3f4-a0a854559557 tempest-SnapshotMetadataTestJSON-582954586 None] Create snapshot completed successfully Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:10 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:10 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:10 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.274s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:53:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "cinder-67e0aa78-65b9-4f14-9106-2b5a2bc245e1-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-67e0aa78-65b9-4f14-9106-2b5a2bc245e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "cinder-quobyte-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-quobyte-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "cinder-quobyte-67e0aa78-65b9-4f14-9106-2b5a2bc245e1" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-quobyte-67e0aa78-65b9-4f14-9106-2b5a2bc245e1" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Deleting offline snapshot 67e0aa78-65b9-4f14-9106-2b5a2bc245e1 of volume 732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] snapshot_file for this snap is: volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17a726-15df-440e-aad3-9c8f813e38f5]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:12 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 Sep 11 13:53:12 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:12 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1" returned: 0 in 0.721s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:53:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a2080-d32d-4f63-bc10-89f0b893a31a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:12 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 Sep 11 13:53:12 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Flow 'volume_create_manager' (1738872c-9e4c-40d1-921e-f2b6be9a9c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7eda73f-970a-4fff-94fd-0a0613b1320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7eda73f-970a-4fff-94fd-0a0613b1320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1812021955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64504831-bb9b-45ad-a158-6d9ab9713858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e320347abe8a479a97c966e97f61bf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:13Z,use_quota=True,user_id='073556cbde6449bfbc7bf49c1fb3e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1f931-6a34-4597-8c96-6cf6112271dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1f931-6a34-4597-8c96-6cf6112271dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec633e-e067-4501-8faa-970e31cfb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec633e-e067-4501-8faa-970e31cfb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64504831-bb9b-45ad-a158-6d9ab9713858', 'volume_name': 'volume-64504831-bb9b-45ad-a158-6d9ab9713858', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac3ba40-17a5-4476-b48e-2d3dcadc4435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac3ba40-17a5-4476-b48e-2d3dcadc4435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6712364c-c119-4915-b440-180c89e2d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:13 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Volume 64504831-bb9b-45ad-a158-6d9ab9713858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64504831-bb9b-45ad-a158-6d9ab9713858', 'volume_size': 1} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1812021955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64504831-bb9b-45ad-a158-6d9ab9713858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e320347abe8a479a97c966e97f61bf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:13Z,use_quota=True,user_id='073556cbde6449bfbc7bf49c1fb3e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Creating volume 64504831-bb9b-45ad-a158-6d9ab9713858 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:53:13 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:13 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 1073741824 Sep 11 13:53:13 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:13 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" returned: 0 in 0.631s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:13 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 Sep 11 13:53:13 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:13 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1" returned: 0 in 0.463s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:13 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 1073741824" returned: 0 in 0.583s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:13 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1 Sep 11 13:53:13 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:13 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 Sep 11 13:53:13 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:14 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77.67e0aa78-65b9-4f14-9106-2b5a2bc245e1" returned: 0 in 0.358s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-quobyte-67e0aa78-65b9-4f14-9106-2b5a2bc245e1" released by "_delete_snapshot" :: held 2.320s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-quobyte-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" released by "delete_snapshot" :: held 2.375s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:14 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858" returned: 0 in 0.369s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6712364c-c119-4915-b440-180c89e2d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64504831-bb9b-45ad-a158-6d9ab9713858', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d116c2ca-37f1-4a28-ae8f-1e0d3cbd9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Volume volume-64504831-bb9b-45ad-a158-6d9ab9713858 (64504831-bb9b-45ad-a158-6d9ab9713858): created successfully Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d116c2ca-37f1-4a28-ae8f-1e0d3cbd9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Flow 'volume_create_manager' (1738872c-9e4c-40d1-921e-f2b6be9a9c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5ab2f7a8-732a-4b91-9832-07994cc959a3 tempest-AttachVolumeTestJSON-1734396399 None] Created volume successfully. Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Created reservations ['836b289b-5c90-4342-a9e6-b11998a4dd51', 'c6ee1d1d-c3c7-420e-8253-f046a6a39720', 'ffd6b9c9-c8e0-4568-98bf-c70cc9424065', 'e1a5591e-c426-40a6-922e-543e7a02239d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Delete snapshot completed successfully. Sep 11 13:53:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-88b4be84-7e65-4f5e-b0b7-8716a9607275 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-67e0aa78-65b9-4f14-9106-2b5a2bc245e1-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "cinder-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "cinder-quobyte-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-quobyte-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabcc42d-708e-4f16-acd1-eb829dc40e60]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:15 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 Sep 11 13:53:15 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:15 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" returned: 0 in 0.509s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:15 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77 Sep 11 13:53:15 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:16 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-quobyte-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77" released by "delete_volume" :: held 0.887s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Created reservations ['876d24e4-58f8-4dbf-a5aa-d63ddfbde475', '6363afa4-5a8b-4a9c-b0c8-a8bcd9b7be0b', 'd3307c0b-f107-487a-babd-b5cb5f9e1980', 'f4ca8f5d-4721-4677-ba4c-6dee3a585d37'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:16 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:16 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:16 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.305s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Deleted volume successfully. Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00ab17b0-5c43-4268-89c9-0b75f4acfdc1 tempest-SnapshotMetadataTestJSON-582954586 None] Lock "cinder-732d0978-8bbb-4dff-a4eb-bb4cbf16dc77-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f4de3045-3259-4673-8563-dc8875f5576f req-22b4e98b-bc09-4084-a205-6e287119ab76 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f4de3045-3259-4673-8563-dc8875f5576f req-22b4e98b-bc09-4084-a205-6e287119ab76 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f4de3045-3259-4673-8563-dc8875f5576f req-22b4e98b-bc09-4084-a205-6e287119ab76 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f4de3045-3259-4673-8563-dc8875f5576f req-22b4e98b-bc09-4084-a205-6e287119ab76 tempest-AttachVolumeTestJSON-1734396399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-64504831-bb9b-45ad-a158-6d9ab9713858', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc4b4fdb-f1b6-4ea1-a1be-482b687b77aa', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:53:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f4de3045-3259-4673-8563-dc8875f5576f req-22b4e98b-bc09-4084-a205-6e287119ab76 tempest-AttachVolumeTestJSON-1734396399 None] attachment_update completed successfully. Sep 11 13:53:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-3efb9c8e-ff1c-4ed3-ba4a-b06d0f7c0b54 req-9fc83382-d381-4807-896c-695082d602bc tempest-AttachVolumeNegativeTest-1005663331 None] Terminate volume connection completed successfully. Sep 11 13:53:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-3efb9c8e-ff1c-4ed3-ba4a-b06d0f7c0b54 req-9fc83382-d381-4807-896c-695082d602bc tempest-AttachVolumeNegativeTest-1005663331 None] Deleting attachment b4d1d6e4-67eb-4920-8427-f5730cc09afa. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:53:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-84e7deda-1a1f-4d1b-accf-594030854286 tempest-GroupSnapshotsTest-174125933 None] Group tempest-GroupSnapshotsTest-Group-1988440251: creating Sep 11 13:53:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-84e7deda-1a1f-4d1b-accf-594030854286 tempest-GroupSnapshotsTest-174125933 None] Group tempest-GroupSnapshotsTest-Group-1988440251: created successfully Sep 11 13:53:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-84e7deda-1a1f-4d1b-accf-594030854286 tempest-GroupSnapshotsTest-174125933 None] Create group completed successfully. Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (d4ff502a-aa86-42a2-a675-c1fe4431c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d5e4f5-2a4a-4e29-84b3-6336552527e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d5e4f5-2a4a-4e29-84b3-6336552527e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1992502241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=308ab895-7b9b-499a-8734-eb3489d07860,host='devstack@QuobyteHD#QuobyteHD',id=a020d57a-e8ca-404f-bb08-c88e33ade52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:21Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cd806d1-3073-4c7f-8f6e-85b119117206),volume_type_id=9cd806d1-3073-4c7f-8f6e-85b119117206)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2eb80-5970-4dbd-a41f-188e163edcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2eb80-5970-4dbd-a41f-188e163edcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e6c06-1716-47d1-8f0f-aa4deec5bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e6c06-1716-47d1-8f0f-aa4deec5bf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a020d57a-e8ca-404f-bb08-c88e33ade52e', 'volume_name': 'volume-a020d57a-e8ca-404f-bb08-c88e33ade52e', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193f2240-ac0d-492d-8766-9fd1c336ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193f2240-ac0d-492d-8766-9fd1c336ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b04693-a09f-4fcb-92a0-1dffba6d847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:21 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Volume a020d57a-e8ca-404f-bb08-c88e33ade52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a020d57a-e8ca-404f-bb08-c88e33ade52e', 'volume_size': 1} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=308ab895-7b9b-499a-8734-eb3489d07860,created_at=2026-09-11T11:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1992502241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=308ab895-7b9b-499a-8734-eb3489d07860,host='devstack@QuobyteHD#QuobyteHD',id=a020d57a-e8ca-404f-bb08-c88e33ade52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:21Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cd806d1-3073-4c7f-8f6e-85b119117206),volume_type_id=9cd806d1-3073-4c7f-8f6e-85b119117206)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Creating volume a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:53:21 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:53:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:21 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e 1073741824 Sep 11 13:53:21 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:22 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e 1073741824" returned: 0 in 0.679s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:22 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e Sep 11 13:53:22 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:22 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b04693-a09f-4fcb-92a0-1dffba6d847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a020d57a-e8ca-404f-bb08-c88e33ade52e', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45917627-e979-4a4b-8306-94e15813a5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:22 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Volume volume-a020d57a-e8ca-404f-bb08-c88e33ade52e (a020d57a-e8ca-404f-bb08-c88e33ade52e): created successfully Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45917627-e979-4a4b-8306-94e15813a5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (d4ff502a-aa86-42a2-a675-c1fe4431c021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4fae8eb0-709d-4af4-83f7-1b5f210a9312 tempest-GroupSnapshotsTest-174125933 None] Created volume successfully. Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Flow 'volume_create_manager' (b1c99764-7330-41e3-91c6-6dcd719b15c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f2d96b-b29b-49f8-ac74-44c765e9e04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f2d96b-b29b-49f8-ac74-44c765e9e04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-112722431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54dcc80-2944-475d-96c2-13e44d6e5822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e891ee9c6214be7aedad3dcd2897632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:23Z,use_quota=True,user_id='78b36849ddc04a029088f5559b0fe0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e257ea-0d08-44fd-9f9d-0adf8e631a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e257ea-0d08-44fd-9f9d-0adf8e631a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b009de51-cb3d-425e-aab2-e26938dd31bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b009de51-cb3d-425e-aab2-e26938dd31bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54dcc80-2944-475d-96c2-13e44d6e5822', 'volume_name': 'volume-b54dcc80-2944-475d-96c2-13e44d6e5822', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ca2a47-7a33-488a-9ae4-acc253b3fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ca2a47-7a33-488a-9ae4-acc253b3fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09739a9-edf8-4581-a2cc-8d5b7adfd369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:23 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Volume b54dcc80-2944-475d-96c2-13e44d6e5822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54dcc80-2944-475d-96c2-13e44d6e5822', 'volume_size': 1} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-112722431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54dcc80-2944-475d-96c2-13e44d6e5822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e891ee9c6214be7aedad3dcd2897632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:23Z,use_quota=True,user_id='78b36849ddc04a029088f5559b0fe0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Creating volume b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:53:23 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:23 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 1073741824 Sep 11 13:53:23 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:23 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 1073741824" returned: 0 in 0.487s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:24 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 Sep 11 13:53:24 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:24 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] GroupSnapshot bf735039-a286-4646-883e-f4d58a82dc96: creating. Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Group snapshot bf735039-a286-4646-883e-f4d58a82dc96: creating. {{(pid=88731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 13:53:24 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822" returned: 0 in 0.509s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Creating offline snapshot 7c32636e-a5d2-429c-87c7-e29c5ccdfda0 of volume a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09739a9-edf8-4581-a2cc-8d5b7adfd369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54dcc80-2944-475d-96c2-13e44d6e5822', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bede471-4b72-4a1c-8968-6bf61a76adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b240a306-0dfa-42cc-ae38-525609d04cc7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:24 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Volume volume-b54dcc80-2944-475d-96c2-13e44d6e5822 (b54dcc80-2944-475d-96c2-13e44d6e5822): created successfully Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bede471-4b72-4a1c-8968-6bf61a76adeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Flow 'volume_create_manager' (b1c99764-7330-41e3-91c6-6dcd719b15c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:24 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-94f6a33f-dd86-4f6f-bd56-efc605cd9a6b tempest-VolumesCloneTest-760821042 None] Created volume successfully. Sep 11 13:53:24 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e Sep 11 13:53:24 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:25 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e" returned: 0 in 0.644s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:25 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 1G Sep 11 13:53:25 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:25 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 1G" returned: 0 in 0.685s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a020d57a-e8ca-404f-bb08-c88e33ade52e -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:26 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a020d57a-e8ca-404f-bb08-c88e33ade52e -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 Sep 11 13:53:26 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:26 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a020d57a-e8ca-404f-bb08-c88e33ade52e -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0" returned: 0 in 0.552s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:26 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:53:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:26 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 Sep 11 13:53:26 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:53:26 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Flow 'volume_create_manager' (cd75a369-ccb6-4483-8a78-8861cb371329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9119fb7c-90fb-45cb-84f6-6a2df404e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0" returned: 0 in 0.497s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9119fb7c-90fb-45cb-84f6-6a2df404e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1354565827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62765468-0c5a-4514-a085-81f6d13e8486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e891ee9c6214be7aedad3dcd2897632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b54dcc80-2944-475d-96c2-13e44d6e5822,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:27Z,use_quota=True,user_id='78b36849ddc04a029088f5559b0fe0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af5cfe7-2b29-40af-a02a-39522c059eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af5cfe7-2b29-40af-a02a-39522c059eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bf94d3-3f37-4baf-b165-e16a5970e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bf94d3-3f37-4baf-b165-e16a5970e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '62765468-0c5a-4514-a085-81f6d13e8486', 'volume_name': 'volume-62765468-0c5a-4514-a085-81f6d13e8486', 'volume_size': 2, 'source_volid': 'b54dcc80-2944-475d-96c2-13e44d6e5822', 'source_volstatus': 'available'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436af0ea-c7e1-4a1d-9d12-ba1b067240a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436af0ea-c7e1-4a1d-9d12-ba1b067240a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4587476d-3506-46d5-ba3d-01e49cd15a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:27 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Volume 62765468-0c5a-4514-a085-81f6d13e8486: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-62765468-0c5a-4514-a085-81f6d13e8486', 'volume_size': 2, 'source_volid': 'b54dcc80-2944-475d-96c2-13e44d6e5822', 'source_volstatus': 'available'} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:27 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info Sep 11 13:53:27 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:27 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:27 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:27 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info Sep 11 13:53:27 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:27 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.info" returned: 0 in 0.310s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.262s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.670s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:27 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Cloning volume b54dcc80-2944-475d-96c2-13e44d6e5822 to volume 62765468-0c5a-4514-a085-81f6d13e8486 Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Creating offline snapshot 97ec0327-ec59-40ea-823b-767f4a92151c of volume b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f27ded-a30d-4a77-92c5-b898565f6ab7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-85475612-ce6e-4970-b4d6-2bd27ef7fa8b tempest-GroupSnapshotsTest-174125933 None] group_snapshot bf735039-a286-4646-883e-f4d58a82dc96: created successfully Sep 11 13:53:28 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 Sep 11 13:53:28 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:28 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822" returned: 0 in 0.433s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:28 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c 1G Sep 11 13:53:28 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:28 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c 1G" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54dcc80-2944-475d-96c2-13e44d6e5822 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:28 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54dcc80-2944-475d-96c2-13e44d6e5822 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c Sep 11 13:53:28 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:29 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54dcc80-2944-475d-96c2-13e44d6e5822 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c" returned: 0 in 0.434s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:29 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c is being set with open permissions: ugo+rw Sep 11 13:53:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:29 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c Sep 11 13:53:29 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:29 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:29 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info Sep 11 13:53:29 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:30 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info" returned: 0 in 0.385s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:30 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info is being set with open permissions: ugo+rw Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:30 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info Sep 11 13:53:30 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:30 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.info" returned: 0 in 0.289s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Acquiring lock "cinder-quobyte-62765468-0c5a-4514-a085-81f6d13e8486" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-62765468-0c5a-4514-a085-81f6d13e8486" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] snapshot: 97ec0327-ec59-40ea-823b-767f4a92151c, volume: 62765468-0c5a-4514-a085-81f6d13e8486, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ac298b-5b31-4a06-b34d-11f9df125242]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:30 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c Sep 11 13:53:30 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:30 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c" returned: 0 in 0.410s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54dcc80-2944-475d-96c2-13e44d6e5822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b9e5d0-43bf-4dba-9fd9-23c85c8c216b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:31 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 Sep 11 13:53:31 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:31 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822" returned: 0 in 0.480s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:53:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:53:31 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:53:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:31 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 Sep 11 13:53:31 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:38 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486" returned: 0 in 7.247s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:38 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:53:38 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Converted 1024.00 MB image at 141.28 MB/s Sep 11 13:53:38 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 is being set with open permissions: ugo+rw Sep 11 13:53:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:38 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 Sep 11 13:53:38 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:39 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486" returned: 0 in 0.528s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-62765468-0c5a-4514-a085-81f6d13e8486" released by "_copy_volume_from_snapshot" :: held 8.766s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Acquiring lock "cinder-quobyte-97ec0327-ec59-40ea-823b-767f4a92151c" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-97ec0327-ec59-40ea-823b-767f4a92151c" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Deleting offline snapshot 97ec0327-ec59-40ea-823b-767f4a92151c of volume b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] snapshot_file for this snap is: volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f16e57-2397-4170-8bcf-18591240d103]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:39 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c Sep 11 13:53:39 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=54,cinder:INSERT=11,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:53:39 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c" returned: 0 in 0.632s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54dcc80-2944-475d-96c2-13e44d6e5822(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:53:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c397751-f69c-443e-9397-d5ee281e83d0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:40 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 Sep 11 13:53:40 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:40 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822" returned: 0 in 0.622s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:40 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c Sep 11 13:53:40 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:40 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:41 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c Sep 11 13:53:41 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:41 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822.97ec0327-ec59-40ea-823b-767f4a92151c" returned: 0 in 0.258s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-97ec0327-ec59-40ea-823b-767f4a92151c" released by "_delete_snapshot" :: held 2.022s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.530s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.545s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-7c32636e-a5d2-429c-87c7-e29c5ccdfda0-19166d98-b7dc-49d1-bb83-e4fded04b27e" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4587476d-3506-46d5-ba3d-01e49cd15a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62765468-0c5a-4514-a085-81f6d13e8486', 'volume_size': 2, 'source_volid': 'b54dcc80-2944-475d-96c2-13e44d6e5822', 'source_volstatus': 'available'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab92c72-0e25-432e-9c1c-3279d73be723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-7c32636e-a5d2-429c-87c7-e29c5ccdfda0-19166d98-b7dc-49d1-bb83-e4fded04b27e" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Creating volume 19166d98-b7dc-49d1-bb83-e4fded04b27e from snapshot 7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-19166d98-b7dc-49d1-bb83-e4fded04b27e" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:41 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Volume volume-62765468-0c5a-4514-a085-81f6d13e8486 (62765468-0c5a-4514-a085-81f6d13e8486): created successfully Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab92c72-0e25-432e-9c1c-3279d73be723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Flow 'volume_create_manager' (cd75a369-ccb6-4483-8a78-8861cb371329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-19166d98-b7dc-49d1-bb83-e4fded04b27e" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] snapshot: 7c32636e-a5d2-429c-87c7-e29c5ccdfda0, volume: 19166d98-b7dc-49d1-bb83-e4fded04b27e, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5e7a294d-a843-4c85-8006-ba7cd9196575 tempest-VolumesCloneTest-760821042 None] Created volume successfully. Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0487417-9f9a-4c08-8431-56186f68adce]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:41 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 Sep 11 13:53:41 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Acquiring lock "cinder-62765468-0c5a-4514-a085-81f6d13e8486-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:42 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Lock "cinder-62765468-0c5a-4514-a085-81f6d13e8486-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0" returned: 0 in 0.565s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a020d57a-e8ca-404f-bb08-c88e33ade52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a09c39-4663-4256-a42a-4b021b67fb5d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Acquiring lock "cinder-quobyte-62765468-0c5a-4514-a085-81f6d13e8486" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-62765468-0c5a-4514-a085-81f6d13e8486" acquired by "delete_volume" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55897efe-2db7-4040-be30-60065b5fdb72]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:42 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e Sep 11 13:53:42 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:42 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 Sep 11 13:53:42 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:42 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e" returned: 0 in 0.580s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:42 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e Sep 11 13:53:42 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:42 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486" returned: 0 in 0.580s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:42 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486 Sep 11 13:53:42 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:43 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62765468-0c5a-4514-a085-81f6d13e8486" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-62765468-0c5a-4514-a085-81f6d13e8486" released by "delete_volume" :: held 0.899s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Created reservations ['47008284-a5c7-4541-90fd-a3e9aa817087', '6f59b065-1db9-4665-9fc9-7bc72b6c5aa6', '8caeead8-6abc-4fc9-bb6d-afe724880758', 'c94e9b36-f0c8-4f9f-88b4-541f07363b56'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:43 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:43 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:43 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.735s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:43 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Deleted volume successfully. Sep 11 13:53:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e02cc1d6-df8b-416d-b7fd-ed6d37e15141 tempest-VolumesCloneTest-760821042 None] Lock "cinder-62765468-0c5a-4514-a085-81f6d13e8486-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Acquiring lock "cinder-b54dcc80-2944-475d-96c2-13e44d6e5822-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Lock "cinder-b54dcc80-2944-475d-96c2-13e44d6e5822-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Acquiring lock "cinder-quobyte-b54dcc80-2944-475d-96c2-13e44d6e5822" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-b54dcc80-2944-475d-96c2-13e44d6e5822" acquired by "delete_volume" :: waited 0.042s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:45 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed1de6-4b76-4882-939c-5daead4c8b22]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:45 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 Sep 11 13:53:45 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:46 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822" returned: 0 in 1.134s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:46 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822 Sep 11 13:53:46 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:46 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b54dcc80-2944-475d-96c2-13e44d6e5822" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Lock "cinder-quobyte-b54dcc80-2944-475d-96c2-13e44d6e5822" released by "delete_volume" :: held 1.697s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:46 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Created reservations ['dcb40b2b-00ff-413e-8b5f-a113e9f66545', 'a089ab3f-d5d2-42c1-b961-077be57d55ea', 'a5d55ac7-8620-4753-a878-cfcc7d08b47d', '5fbb5259-7237-468e-9cbb-98ce344b9ce4'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:47 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:47 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:48 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.978s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:48 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Deleted volume successfully. Sep 11 13:53:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-090a0d4e-a3f6-4efe-9155-e82f67f7e5a9 tempest-VolumesCloneTest-760821042 None] Lock "cinder-b54dcc80-2944-475d-96c2-13e44d6e5822-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:50 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e" returned: 0 in 7.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:53:50 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Converted 1024.00 MB image at 140.42 MB/s Sep 11 13:53:50 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:50 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e Sep 11 13:53:50 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:50 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e" returned: 0 in 0.397s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-19166d98-b7dc-49d1-bb83-e4fded04b27e" released by "_copy_volume_from_snapshot" :: held 8.963s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-7c32636e-a5d2-429c-87c7-e29c5ccdfda0-19166d98-b7dc-49d1-bb83-e4fded04b27e" released by "_create_volume_from_snapshot" :: held 9.109s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.157s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cfeaa866-875e-479b-9820-8680007aa13a tempest-GroupSnapshotsTest-174125933 None] Create group from source-snapshot-bf735039-a286-4646-883e-f4d58a82dc96 completed successfully. Sep 11 13:53:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-ed663755-74bd-495f-b120-4e2b65d9ae7e req-d7e3012a-e69a-43ff-92de-2362f4190823 tempest-AttachVolumeTestJSON-1734396399 None] Terminate volume connection completed successfully. Sep 11 13:53:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-ed663755-74bd-495f-b120-4e2b65d9ae7e req-d7e3012a-e69a-43ff-92de-2362f4190823 tempest-AttachVolumeTestJSON-1734396399 None] Deleting attachment dc4b4fdb-f1b6-4ea1-a1be-482b687b77aa. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:53:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-19166d98-b7dc-49d1-bb83-e4fded04b27e" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-19166d98-b7dc-49d1-bb83-e4fded04b27e" acquired by "delete_volume" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8d595-4d1c-4489-b4d9-2e4e2a09f45d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:51 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e Sep 11 13:53:51 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:52 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e" returned: 0 in 0.620s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:52 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e Sep 11 13:53:52 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:52 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19166d98-b7dc-49d1-bb83-e4fded04b27e" returned: 0 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-19166d98-b7dc-49d1-bb83-e4fded04b27e" released by "delete_volume" :: held 1.024s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Created reservations ['54b11b9b-ea2b-46a1-bf3e-b50ef6f0d3de'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:52 devstack cinder-volume[88731]: WARNING cinder.quota [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-941334703 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-941334703, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:53:52 devstack cinder-volume[88731]: WARNING cinder.quota [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-941334703 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-941334703, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Created reservations ['26937ab1-1cf4-4fa4-92e7-25cc48af73f6', '2b75fc64-3dbf-4baa-a309-45f11275b2d2', '6db6f8ab-8868-4fc0-9b20-626c5e74a90c', 'f24bdc4b-d453-4f86-8045-64ff2d2f9b68'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:52 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:52 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] group_snapshot bf735039-a286-4646-883e-f4d58a82dc96: deleting Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] group_snapshot bf735039-a286-4646-883e-f4d58a82dc96: deleting {{(pid=88731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-a020d57a-e8ca-404f-bb08-c88e33ade52e" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-a020d57a-e8ca-404f-bb08-c88e33ade52e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-7c32636e-a5d2-429c-87c7-e29c5ccdfda0" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-7c32636e-a5d2-429c-87c7-e29c5ccdfda0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Deleting offline snapshot 7c32636e-a5d2-429c-87c7-e29c5ccdfda0 of volume a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] snapshot_file for this snap is: volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f6beb-d4d6-4aa0-8959-08e7c6965974]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:53 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 Sep 11 13:53:53 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:53 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1be29cc6-09f6-4a65-98f6-2b670708f60e tempest-GroupSnapshotsTest-174125933 None] Delete group completed successfully. Sep 11 13:53:53 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a020d57a-e8ca-404f-bb08-c88e33ade52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e35a462-fffe-49b6-857b-a17ac73fa22b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:54 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e Sep 11 13:53:54 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:54 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e" returned: 0 in 0.684s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:54 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 Sep 11 13:53:54 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:54 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0" returned: 0 in 0.497s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:55 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0 Sep 11 13:53:55 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:55 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e.7c32636e-a5d2-429c-87c7-e29c5ccdfda0" returned: 0 in 0.357s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-7c32636e-a5d2-429c-87c7-e29c5ccdfda0" released by "_delete_snapshot" :: held 2.195s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-a020d57a-e8ca-404f-bb08-c88e33ade52e" released by "delete_snapshot" :: held 2.235s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:55 devstack cinder-volume[88731]: WARNING cinder.quota [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-941334703 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-941334703, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:53:55 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] Created reservations ['a4d00c6c-7234-4007-ab38-5ff87e61f24c', '4f8f02f0-d50a-4797-bded-ae8739fdc1ad', '49d6a4cb-f67e-4902-b3f1-f58c32c2ce91', '1af725df-e8cb-4217-88a5-77153f3bd809'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f59c77f2-0cf5-4a2c-9f1d-5292bdaf785b tempest-GroupSnapshotsTest-174125933 None] group_snapshot bf735039-a286-4646-883e-f4d58a82dc96: deleted successfully Sep 11 13:53:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-a020d57a-e8ca-404f-bb08-c88e33ade52e" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:53:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-a020d57a-e8ca-404f-bb08-c88e33ade52e" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:53:57 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc42acd-3977-499a-8043-580d72e0b020]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:53:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:57 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e Sep 11 13:53:57 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:57 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e" returned: 0 in 0.619s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:57 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e Sep 11 13:53:57 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:58 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a020d57a-e8ca-404f-bb08-c88e33ade52e" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-a020d57a-e8ca-404f-bb08-c88e33ade52e" released by "delete_volume" :: held 1.070s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Created reservations ['b08c83b1-5a6b-4f88-94f9-06d280e72dab'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:58 devstack cinder-volume[88731]: WARNING cinder.db.api [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-941334703'] Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Created reservations ['5ac3b514-8eca-4ffd-aac2-e3cd22e371d1', '2ebdbba8-e333-4e5e-af50-e07ff64c38bc', '11c95134-4b18-4633-bfef-9f745ca09502', '7994ec9a-c054-4108-bdc3-c7467e932091'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:58 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:53:58 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:58 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.292s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:58 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:53:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-37fba4b2-bc1c-4e37-b283-1b707c93b537 tempest-GroupSnapshotsTest-174125933 None] Delete group completed successfully. Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Flow 'volume_create_manager' (5e2fe37a-6a0b-4bc1-8189-4c8f8f8fa314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08aef4fb-7d5b-4f6e-b20d-66fe63e6f74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08aef4fb-7d5b-4f6e-b20d-66fe63e6f74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-122724907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce81aab-09ee-4b88-aa2d-a240b74570a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933e8a5afabb47cf8652ce80dc6445de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:59Z,use_quota=True,user_id='5534bcf77e5c469785da15e56934b3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0540f9-840e-448c-8cdf-c324f8a0cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0540f9-840e-448c-8cdf-c324f8a0cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356b56cc-d4d9-4f22-a923-8ebd445d68d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356b56cc-d4d9-4f22-a923-8ebd445d68d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce81aab-09ee-4b88-aa2d-a240b74570a9', 'volume_name': 'volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27ae0dc-2c1f-4509-be7f-280506ffb32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27ae0dc-2c1f-4509-be7f-280506ffb32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f53fa5-5a92-486c-bedc-f12b41e58eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:53:59 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Volume 1ce81aab-09ee-4b88-aa2d-a240b74570a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9', 'volume_size': 1} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-122724907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce81aab-09ee-4b88-aa2d-a240b74570a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933e8a5afabb47cf8652ce80dc6445de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:53:59Z,use_quota=True,user_id='5534bcf77e5c469785da15e56934b3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Creating volume 1ce81aab-09ee-4b88-aa2d-a240b74570a9 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:53:59 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:59 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 1073741824 Sep 11 13:53:59 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:53:59 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 1073741824" returned: 0 in 0.584s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=93,cinder:UPDATE=109,cinder:INSERT=25,cinder:DELETE=6 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:53:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:53:59 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 Sep 11 13:53:59 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9f3cfb3f-ba01-4ea2-ac10-3fe9acf72809 tempest-GroupSnapshotsTest-174125933 None] Group tempest-GroupSnapshotsTest-Group-1224516168: creating Sep 11 13:54:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9f3cfb3f-ba01-4ea2-ac10-3fe9acf72809 tempest-GroupSnapshotsTest-174125933 None] Group tempest-GroupSnapshotsTest-Group-1224516168: created successfully Sep 11 13:54:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9f3cfb3f-ba01-4ea2-ac10-3fe9acf72809 tempest-GroupSnapshotsTest-174125933 None] Create group completed successfully. Sep 11 13:54:00 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9" returned: 0 in 0.396s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f53fa5-5a92-486c-bedc-f12b41e58eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878d61d2-7a0b-4e15-9274-05f2a5aaa395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:00 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Volume volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 (1ce81aab-09ee-4b88-aa2d-a240b74570a9): created successfully Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878d61d2-7a0b-4e15-9274-05f2a5aaa395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Flow 'volume_create_manager' (5e2fe37a-6a0b-4bc1-8189-4c8f8f8fa314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-faa527e8-0750-42a0-b50f-75d20bc0f415 tempest-VolumesNegativeTest-857174151 None] Created volume successfully. Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (263b5ee8-1388-4326-9faa-57b7b0b2db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dda17e5-c65d-48b4-86a2-3d3297eda4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dda17e5-c65d-48b4-86a2-3d3297eda4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066268427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3788bb5c-321b-48f5-99cb-897c334eab4c,host='devstack@QuobyteHD#QuobyteHD',id=58086d28-f5d0-460c-9e45-685db2a0f9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:02Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1f9e78f-c0a2-4ca8-a983-4d134f31e280),volume_type_id=c1f9e78f-c0a2-4ca8-a983-4d134f31e280)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2331c9b8-bf6a-45da-93ea-6464640da201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2331c9b8-bf6a-45da-93ea-6464640da201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a357496d-7fb2-4f93-bc45-ee4bcfca38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a357496d-7fb2-4f93-bc45-ee4bcfca38c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58086d28-f5d0-460c-9e45-685db2a0f9f7', 'volume_name': 'volume-58086d28-f5d0-460c-9e45-685db2a0f9f7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7876edd4-e563-458b-bf72-6be82a2e9a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7876edd4-e563-458b-bf72-6be82a2e9a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041e0c7d-4591-4496-92d2-aebdf01a7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:01 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Volume 58086d28-f5d0-460c-9e45-685db2a0f9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58086d28-f5d0-460c-9e45-685db2a0f9f7', 'volume_size': 1} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3788bb5c-321b-48f5-99cb-897c334eab4c,created_at=2026-09-11T11:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066268427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3788bb5c-321b-48f5-99cb-897c334eab4c,host='devstack@QuobyteHD#QuobyteHD',id=58086d28-f5d0-460c-9e45-685db2a0f9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:02Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1f9e78f-c0a2-4ca8-a983-4d134f31e280),volume_type_id=c1f9e78f-c0a2-4ca8-a983-4d134f31e280)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Creating volume 58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:01 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:02 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 1073741824 Sep 11 13:54:02 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:02 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 1073741824" returned: 0 in 0.652s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:02 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 Sep 11 13:54:02 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:03 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7" returned: 0 in 0.361s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041e0c7d-4591-4496-92d2-aebdf01a7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58086d28-f5d0-460c-9e45-685db2a0f9f7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d9957e-27e5-4d04-8d28-02f09d832e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Volume volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 (58086d28-f5d0-460c-9e45-685db2a0f9f7): created successfully Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d9957e-27e5-4d04-8d28-02f09d832e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (263b5ee8-1388-4326-9faa-57b7b0b2db5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:03 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3edddfac-0753-4f15-8cad-899633ccd70c tempest-GroupSnapshotsTest-174125933 None] Created volume successfully. Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Flow 'volume_create_manager' (350cf2eb-d646-433e-bd8e-3422517a389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8e9464-32fa-4b43-b305-0d10427a39ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8e9464-32fa-4b43-b305-0d10427a39ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1416487455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42655d95-d5b3-493a-9ecd-a757baed3c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1e90416eb43aeaef515be261d5dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:04Z,use_quota=True,user_id='c4c2088dbb3548489f095e8a2e1a4110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c735e81-823e-45a0-b3c0-d738af0fcd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c735e81-823e-45a0-b3c0-d738af0fcd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f623ba-083b-4f1e-924f-4dc501a75926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f623ba-083b-4f1e-924f-4dc501a75926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42655d95-d5b3-493a-9ecd-a757baed3c9a', 'volume_name': 'volume-42655d95-d5b3-493a-9ecd-a757baed3c9a', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f74b60-281f-4b89-90e6-c2131fb9c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f74b60-281f-4b89-90e6-c2131fb9c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc3c70-7e1f-4e5f-862e-d8be3668289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Volume 42655d95-d5b3-493a-9ecd-a757baed3c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42655d95-d5b3-493a-9ecd-a757baed3c9a', 'volume_size': 1} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1416487455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42655d95-d5b3-493a-9ecd-a757baed3c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1e90416eb43aeaef515be261d5dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:04Z,use_quota=True,user_id='c4c2088dbb3548489f095e8a2e1a4110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Creating volume 42655d95-d5b3-493a-9ecd-a757baed3c9a {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:03 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:03 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a 1073741824 Sep 11 13:54:03 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:04 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a 1073741824" returned: 0 in 0.578s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:04 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a Sep 11 13:54:04 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:05 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a" returned: 0 in 0.571s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc3c70-7e1f-4e5f-862e-d8be3668289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42655d95-d5b3-493a-9ecd-a757baed3c9a', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078263d7-e1c2-41b8-8791-1ed9432b59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Volume volume-42655d95-d5b3-493a-9ecd-a757baed3c9a (42655d95-d5b3-493a-9ecd-a757baed3c9a): created successfully Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078263d7-e1c2-41b8-8791-1ed9432b59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Flow 'volume_create_manager' (350cf2eb-d646-433e-bd8e-3422517a389b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-781f8b55-f28e-4881-9456-f567bc7b1a7b tempest-AttachVolumeNegativeTest-1005663331 None] Created volume successfully. Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (d0b9aa40-97da-450d-81fd-791eab49b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857e65da-cf1b-42f9-b35f-59f8f07699e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857e65da-cf1b-42f9-b35f-59f8f07699e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-70108250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3788bb5c-321b-48f5-99cb-897c334eab4c,host='devstack@QuobyteHD#QuobyteHD',id=88c0945e-bf4b-44df-b68e-afa85c89d7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:06Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1f9e78f-c0a2-4ca8-a983-4d134f31e280),volume_type_id=c1f9e78f-c0a2-4ca8-a983-4d134f31e280)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2aa8559-9cc2-4823-bc9a-2e56286b42e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2aa8559-9cc2-4823-bc9a-2e56286b42e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85722ceb-3f3a-4062-bdb8-0a795482ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85722ceb-3f3a-4062-bdb8-0a795482ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c0945e-bf4b-44df-b68e-afa85c89d7ad', 'volume_name': 'volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a187071-eb62-446c-ba04-fde90d5c80b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a187071-eb62-446c-ba04-fde90d5c80b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cf5a7e-6f8d-4ddf-aca6-4d9f6946ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Volume 88c0945e-bf4b-44df-b68e-afa85c89d7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad', 'volume_size': 1} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3788bb5c-321b-48f5-99cb-897c334eab4c,created_at=2026-09-11T11:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-70108250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3788bb5c-321b-48f5-99cb-897c334eab4c,host='devstack@QuobyteHD#QuobyteHD',id=88c0945e-bf4b-44df-b68e-afa85c89d7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:06Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1f9e78f-c0a2-4ca8-a983-4d134f31e280),volume_type_id=c1f9e78f-c0a2-4ca8-a983-4d134f31e280)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Creating volume 88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:05 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad 1073741824 Sep 11 13:54:05 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:06 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad 1073741824" returned: 0 in 0.772s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:06 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad Sep 11 13:54:06 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:07 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad" returned: 0 in 0.430s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cf5a7e-6f8d-4ddf-aca6-4d9f6946ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ae2047-49ea-4962-a46b-25aaf4e0ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Volume volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad (88c0945e-bf4b-44df-b68e-afa85c89d7ad): created successfully Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ae2047-49ea-4962-a46b-25aaf4e0ad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (d0b9aa40-97da-450d-81fd-791eab49b140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-dbd519c0-a798-4b66-aff0-b83201bf2ca8 tempest-GroupSnapshotsTest-174125933 None] Created volume successfully. Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-41c40024-7650-4b3b-a44d-3bfcd272f89f req-d7a530ba-3eaf-4d6b-85da-c714dc439dc3 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-41c40024-7650-4b3b-a44d-3bfcd272f89f req-d7a530ba-3eaf-4d6b-85da-c714dc439dc3 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-41c40024-7650-4b3b-a44d-3bfcd272f89f req-d7a530ba-3eaf-4d6b-85da-c714dc439dc3 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-41c40024-7650-4b3b-a44d-3bfcd272f89f req-d7a530ba-3eaf-4d6b-85da-c714dc439dc3 tempest-AttachVolumeNegativeTest-1005663331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-42655d95-d5b3-493a-9ecd-a757baed3c9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1b84471-cc30-4d6d-9aa6-8ffe211be836', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:54:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-41c40024-7650-4b3b-a44d-3bfcd272f89f req-d7a530ba-3eaf-4d6b-85da-c714dc439dc3 tempest-AttachVolumeNegativeTest-1005663331 None] attachment_update completed successfully. Sep 11 13:54:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-02cd9285-5ad4-471d-8bb1-4301d7b75b5a tempest-GroupSnapshotsTest-174125933 None] Update group completed successfully. Sep 11 13:54:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-93f672b1-484f-4093-8cdb-8cf22e34d59d tempest-GroupSnapshotsTest-174125933 None] Update group completed successfully. Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:10 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:54:10 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-bcbcf5d2-5d3f-475d-a414-ff0c69cf8935 req-ee573f2d-a87f-43f2-8c99-ac289c767477 tempest-AttachVolumeNegativeTest-1005663331 None] Terminate volume connection completed successfully. Sep 11 13:54:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-bcbcf5d2-5d3f-475d-a414-ff0c69cf8935 req-ee573f2d-a87f-43f2-8c99-ac289c767477 tempest-AttachVolumeNegativeTest-1005663331 None] Deleting attachment d1b84471-cc30-4d6d-9aa6-8ffe211be836. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:54:11 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.510s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:54:11 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:54:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:54:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:54:11 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-91991a34-10d0-44c9-b932-4eca0e121357 tempest-GroupSnapshotsTest-174125933 None] Update group completed successfully. Sep 11 13:54:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a3d37d76-54ab-4e4f-a3c4-60eb80d8d32f tempest-GroupSnapshotsTest-174125933 None] Update group completed successfully. Sep 11 13:54:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] GroupSnapshot c356582f-ae9b-4b94-92c2-09a4c649fe62: creating. Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Group snapshot c356582f-ae9b-4b94-92c2-09a4c649fe62: creating. {{(pid=88731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Creating offline snapshot 0888c230-b665-40f3-ad5c-5c5124dcece6 of volume 58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[757471e5-8bc8-47c4-85b6-ecbc3a644dab]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:14 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 Sep 11 13:54:14 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:14 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7" returned: 0 in 0.469s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:14 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 1G Sep 11 13:54:14 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:15 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 1G" returned: 0 in 0.452s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:15 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 Sep 11 13:54:15 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:15 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:15 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:54:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:15 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 Sep 11 13:54:15 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:15 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:15 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info Sep 11 13:54:15 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:16 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:16 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:16 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info Sep 11 13:54:16 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:16 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.info" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Creating offline snapshot 4be7cf52-31ed-48ef-80a9-6f8b2a467435 of volume 88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd16038-a8f2-4f2b-bf6a-991c6a71db3c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:16 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad Sep 11 13:54:16 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:16 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad" returned: 0 in 0.451s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:16 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 1G Sep 11 13:54:16 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:17 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 1G" returned: 0 in 0.693s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:17 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 Sep 11 13:54:17 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:17 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435" returned: 0 in 0.441s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:17 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:54:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:17 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 Sep 11 13:54:17 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:18 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435" returned: 0 in 0.322s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:18 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info Sep 11 13:54:18 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:18 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info" returned: 0 in 0.339s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:18 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:54:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:18 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info Sep 11 13:54:18 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:18 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.info" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-43147523-334e-4237-a29a-b235869afbc7 tempest-GroupSnapshotsTest-174125933 None] group_snapshot c356582f-ae9b-4b94-92c2-09a4c649fe62: created successfully Sep 11 13:54:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] group_snapshot c356582f-ae9b-4b94-92c2-09a4c649fe62: deleting Sep 11 13:54:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] group_snapshot c356582f-ae9b-4b94-92c2-09a4c649fe62: deleting {{(pid=88731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 13:54:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-58086d28-f5d0-460c-9e45-685db2a0f9f7" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-58086d28-f5d0-460c-9e45-685db2a0f9f7" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-0888c230-b665-40f3-ad5c-5c5124dcece6" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-0888c230-b665-40f3-ad5c-5c5124dcece6" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Deleting offline snapshot 0888c230-b665-40f3-ad5c-5c5124dcece6 of volume 58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] snapshot_file for this snap is: volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c045b0e-9ef4-4a2b-a498-243a07c29d9b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:20 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 Sep 11 13:54:20 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:20 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6" returned: 0 in 0.661s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58086d28-f5d0-460c-9e45-685db2a0f9f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae82af8-b3c4-4da0-9d22-7909d78f4d8d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:20 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 Sep 11 13:54:20 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:21 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7" returned: 0 in 0.820s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:21 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 Sep 11 13:54:21 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:22 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6" returned: 0 in 0.502s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:22 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6 Sep 11 13:54:22 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:22 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7.0888c230-b665-40f3-ad5c-5c5124dcece6" returned: 0 in 0.306s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-0888c230-b665-40f3-ad5c-5c5124dcece6" released by "_delete_snapshot" :: held 2.529s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-58086d28-f5d0-460c-9e45-685db2a0f9f7" released by "delete_snapshot" :: held 2.626s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-88c0945e-bf4b-44df-b68e-afa85c89d7ad" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-88c0945e-bf4b-44df-b68e-afa85c89d7ad" acquired by "delete_snapshot" :: waited 0.063s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-4be7cf52-31ed-48ef-80a9-6f8b2a467435" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-4be7cf52-31ed-48ef-80a9-6f8b2a467435" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Deleting offline snapshot 4be7cf52-31ed-48ef-80a9-6f8b2a467435 of volume 88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] snapshot_file for this snap is: volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a4d3ca-fd52-4154-adcc-a3caf4c643b0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:22 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 Sep 11 13:54:22 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:23 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435" returned: 0 in 0.580s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:54:23 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce5b2f-3ec1-4dc3-a31e-ca1d5f29bdc7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:23 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad Sep 11 13:54:23 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:23 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:23 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 Sep 11 13:54:23 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:24 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435" returned: 0 in 0.527s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:24 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435 Sep 11 13:54:24 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:24 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad.4be7cf52-31ed-48ef-80a9-6f8b2a467435" returned: 0 in 0.477s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-4be7cf52-31ed-48ef-80a9-6f8b2a467435" released by "_delete_snapshot" :: held 2.272s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-88c0945e-bf4b-44df-b68e-afa85c89d7ad" released by "delete_snapshot" :: held 2.306s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:25 devstack cinder-volume[88731]: WARNING cinder.quota [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1052866803 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1052866803, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:54:25 devstack cinder-volume[88731]: WARNING cinder.quota [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1052866803 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1052866803, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Created reservations ['8a40024d-38ed-4777-a056-c7e4f63b862d', '54b02e9c-c926-417a-ad4c-a1d356e6c24a', 'b42d5cb2-7c33-4921-ac18-9704b63d864c', '192a754c-c335-43da-baa4-7223cdd518c4'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] Created reservations ['3a94693d-74e1-451c-bd12-52f559ea757a', '35905d93-b845-4f58-a920-d61da1733fe5', '65bfb431-aee6-4278-8f8c-714208d39b29', '9bd4d9f4-7af9-43f1-ad76-5b2f30fe0a76'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-04c94cef-54f6-4c06-88c2-11084401c61d tempest-GroupSnapshotsTest-174125933 None] group_snapshot c356582f-ae9b-4b94-92c2-09a4c649fe62: deleted successfully Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Acquiring lock "cinder-1ce81aab-09ee-4b88-aa2d-a240b74570a9-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Lock "cinder-1ce81aab-09ee-4b88-aa2d-a240b74570a9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Acquiring lock "cinder-quobyte-1ce81aab-09ee-4b88-aa2d-a240b74570a9" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Lock "cinder-quobyte-1ce81aab-09ee-4b88-aa2d-a240b74570a9" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb3fe88-43d5-4fa7-aa3c-6eb9be7e99b8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:25 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 Sep 11 13:54:25 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:26 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9" returned: 0 in 0.435s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-58086d28-f5d0-460c-9e45-685db2a0f9f7" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:26 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9 Sep 11 13:54:26 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-58086d28-f5d0-460c-9e45-685db2a0f9f7" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d4c086-14a0-4d41-8019-347079991add]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:26 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 Sep 11 13:54:26 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:26 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ce81aab-09ee-4b88-aa2d-a240b74570a9" returned: 0 in 0.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Lock "cinder-quobyte-1ce81aab-09ee-4b88-aa2d-a240b74570a9" released by "delete_volume" :: held 0.911s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Created reservations ['caed2988-95a7-410d-b448-40a8f297651f', '73d5a401-5596-4bd2-b1c0-9bb80d5f7273', '57f5e6d8-cca1-4f7c-82e8-26f407a25ffd', 'e6afc75b-91e2-4f3c-af8e-4778252ed9a8'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:26 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7" returned: 0 in 0.501s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:26 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:54:26 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:26 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7 Sep 11 13:54:26 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:27 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.407s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:54:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Deleted volume successfully. Sep 11 13:54:27 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9e52c55-3bc0-4942-920b-0aaa5ea5c255 tempest-VolumesNegativeTest-857174151 None] Lock "cinder-1ce81aab-09ee-4b88-aa2d-a240b74570a9-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58086d28-f5d0-460c-9e45-685db2a0f9f7" returned: 0 in 0.442s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-58086d28-f5d0-460c-9e45-685db2a0f9f7" released by "delete_volume" :: held 1.032s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-88c0945e-bf4b-44df-b68e-afa85c89d7ad" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-88c0945e-bf4b-44df-b68e-afa85c89d7ad" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[25500c38-3e91-4c5d-b79c-22e6847fef62]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:27 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad Sep 11 13:54:27 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:28 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad" returned: 0 in 0.792s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:28 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad Sep 11 13:54:28 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:28 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-88c0945e-bf4b-44df-b68e-afa85c89d7ad" returned: 0 in 0.345s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-88c0945e-bf4b-44df-b68e-afa85c89d7ad" released by "delete_volume" :: held 1.293s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Created reservations ['fdb52f29-1a5f-45f8-b1bc-dc6500f8899a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:28 devstack cinder-volume[88731]: WARNING cinder.quota [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1052866803 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1052866803, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Created reservations ['2c5fdb7d-ddcd-4c6c-8d84-3757bb9c45a6', '54c155f7-2fe4-4c9e-88ce-41d2f1e52f4e', '686228bd-20de-45ae-8950-63ce8e053848', 'a5c1704b-a3ee-40f2-b920-2a975498f1e1'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Created reservations ['fb25262d-1ce0-4e0f-897e-e97a5c1f9374', '13e7e470-5355-4f7c-8491-37ac9b6e7ed9', '310d1efd-4d80-43ce-8439-9ed82927c6ad', '676d46e7-7197-472a-a483-42a6707250b8'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:29 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:54:29 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:29 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.470s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:29 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:54:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4822d07e-068b-4bca-af68-fea043769f6c tempest-GroupSnapshotsTest-174125933 None] Delete group completed successfully. Sep 11 13:54:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-11139238-6322-45c1-8ee6-335addabdac9 tempest-GroupSnapshotsTest-174125933 None] Group tempest-GroupSnapshotsTest-Group-2054527830: creating Sep 11 13:54:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-11139238-6322-45c1-8ee6-335addabdac9 tempest-GroupSnapshotsTest-174125933 None] Group tempest-GroupSnapshotsTest-Group-2054527830: created successfully Sep 11 13:54:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-11139238-6322-45c1-8ee6-335addabdac9 tempest-GroupSnapshotsTest-174125933 None] Create group completed successfully. Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (52429b89-911b-4cb6-8586-9c18f46811b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f025b04c-1465-42b7-8458-785a0e1d0ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f025b04c-1465-42b7-8458-785a0e1d0ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1823204285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=542cf5ec-e631-43d8-858e-fc73bace279f,host='devstack@QuobyteHD#QuobyteHD',id=4b1aaead-9b2b-481e-9b9a-7b4274124749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:33Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b60897e-7f5f-412c-b69a-72f254db991b),volume_type_id=0b60897e-7f5f-412c-b69a-72f254db991b)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566a759c-b36c-4e66-aaa6-32df4ba6f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566a759c-b36c-4e66-aaa6-32df4ba6f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae820f9-1732-4371-85f9-ee658e35474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae820f9-1732-4371-85f9-ee658e35474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1aaead-9b2b-481e-9b9a-7b4274124749', 'volume_name': 'volume-4b1aaead-9b2b-481e-9b9a-7b4274124749', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd336120-e59e-4492-bac4-ec2eaefc7f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd336120-e59e-4492-bac4-ec2eaefc7f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe1b536-d77f-4051-9be0-af782a03b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Volume 4b1aaead-9b2b-481e-9b9a-7b4274124749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1aaead-9b2b-481e-9b9a-7b4274124749', 'volume_size': 1} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=542cf5ec-e631-43d8-858e-fc73bace279f,created_at=2026-09-11T11:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1823204285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=542cf5ec-e631-43d8-858e-fc73bace279f,host='devstack@QuobyteHD#QuobyteHD',id=4b1aaead-9b2b-481e-9b9a-7b4274124749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07598f0b9f5b47369b09a276ecc6ef1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:33Z,use_quota=True,user_id='68f131ea872a4cf7b0edc7674446729e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b60897e-7f5f-412c-b69a-72f254db991b),volume_type_id=0b60897e-7f5f-412c-b69a-72f254db991b)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Creating volume 4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:32 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:32 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 1073741824 Sep 11 13:54:32 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:33 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 1073741824" returned: 0 in 0.687s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:33 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 Sep 11 13:54:33 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:34 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe1b536-d77f-4051-9be0-af782a03b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1aaead-9b2b-481e-9b9a-7b4274124749', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9244c58-eb48-4711-b005-5f9b3877fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Volume volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 (4b1aaead-9b2b-481e-9b9a-7b4274124749): created successfully Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9244c58-eb48-4711-b005-5f9b3877fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Flow 'volume_create_manager' (52429b89-911b-4cb6-8586-9c18f46811b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1034e1a2-c570-4d73-9f43-ad0afaebf180 tempest-GroupSnapshotsTest-174125933 None] Created volume successfully. Sep 11 13:54:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] GroupSnapshot 4520b7d5-b7b2-44c7-ba44-df3a9511becf: creating. Sep 11 13:54:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Group snapshot 4520b7d5-b7b2-44c7-ba44-df3a9511becf: creating. {{(pid=88731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 13:54:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Creating offline snapshot cd6d53d5-38e0-473e-85a2-aa65994f40ce of volume 4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:54:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c9d0de-1233-479b-b2c6-84532ce2a0ad]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:35 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 Sep 11 13:54:35 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:36 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749" returned: 0 in 0.582s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:36 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce 1G Sep 11 13:54:36 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:36 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce 1G" returned: 0 in 0.624s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:36 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce Sep 11 13:54:36 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:37 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce" returned: 0 in 0.820s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:54:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:37 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce Sep 11 13:54:37 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:38 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce" returned: 0 in 0.454s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:38 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info Sep 11 13:54:38 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:38 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info" returned: 0 in 0.533s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:38 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:54:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:38 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info Sep 11 13:54:38 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:39 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.info" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-fafe2ea2-cde5-40aa-92fa-a8eb96150613 tempest-GroupSnapshotsTest-174125933 None] group_snapshot 4520b7d5-b7b2-44c7-ba44-df3a9511becf: created successfully Sep 11 13:54:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] group_snapshot 4520b7d5-b7b2-44c7-ba44-df3a9511becf: deleting Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=6,cinder:SELECT=112 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] group_snapshot 4520b7d5-b7b2-44c7-ba44-df3a9511becf: deleting {{(pid=88731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-4b1aaead-9b2b-481e-9b9a-7b4274124749" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-4b1aaead-9b2b-481e-9b9a-7b4274124749" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-cd6d53d5-38e0-473e-85a2-aa65994f40ce" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-cd6d53d5-38e0-473e-85a2-aa65994f40ce" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Deleting offline snapshot cd6d53d5-38e0-473e-85a2-aa65994f40ce of volume 4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] snapshot_file for this snap is: volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f5f25-e9d9-4b61-ba60-e62a4de6763d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:41 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce Sep 11 13:54:41 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:41 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce" returned: 0 in 0.784s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b1aaead-9b2b-481e-9b9a-7b4274124749(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:54:41 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af61b9-cca0-4fce-bac1-0185b7c675e9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:41 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 Sep 11 13:54:41 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:42 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749" returned: 0 in 0.615s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:42 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce Sep 11 13:54:42 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:43 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce" returned: 0 in 0.678s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:43 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce Sep 11 13:54:43 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:43 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749.cd6d53d5-38e0-473e-85a2-aa65994f40ce" returned: 0 in 0.531s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-cd6d53d5-38e0-473e-85a2-aa65994f40ce" released by "_delete_snapshot" :: held 2.931s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-4b1aaead-9b2b-481e-9b9a-7b4274124749" released by "delete_snapshot" :: held 3.034s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:43 devstack cinder-volume[88731]: WARNING cinder.quota [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1731212836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1731212836, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:54:43 devstack cinder-volume[88731]: WARNING cinder.quota [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1731212836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1731212836, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:54:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] Created reservations ['20a60877-8180-42bc-8fc4-044b4533a4a7', '4b8f09d8-5e31-4f09-8736-0b5d678481ad', '25985518-125c-47c3-ba22-b49bdd3fa455', '8373c201-b37b-46ce-92eb-478b04168f35'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-00b6892a-4068-4e5e-95aa-416d94ea0f3a tempest-GroupSnapshotsTest-174125933 None] group_snapshot 4520b7d5-b7b2-44c7-ba44-df3a9511becf: deleted successfully Sep 11 13:54:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "cinder-quobyte-4b1aaead-9b2b-481e-9b9a-7b4274124749" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-4b1aaead-9b2b-481e-9b9a-7b4274124749" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f948a98-3955-4b12-8845-9b04324b2711]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:44 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 Sep 11 13:54:44 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:45 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749" returned: 0 in 0.469s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:45 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749 Sep 11 13:54:45 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:45 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4b1aaead-9b2b-481e-9b9a-7b4274124749" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Lock "cinder-quobyte-4b1aaead-9b2b-481e-9b9a-7b4274124749" released by "delete_volume" :: held 0.819s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Created reservations ['528b2369-3f0a-4efa-9795-7806cd23543d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:45 devstack cinder-volume[88731]: WARNING cinder.quota [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1731212836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1731212836, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Created reservations ['9af997a1-a659-486e-b80c-86022348486d', '086738af-db5f-4d58-965c-12d9044430d0', '2f4a30ff-c234-4caa-b5d3-412b04501b63', '6bb023fe-868b-4b06-b993-e159769cc271'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:45 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:54:45 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:46 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.340s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:46 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:54:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-53a7067c-3054-4cdd-a739-c95e4128321c tempest-GroupSnapshotsTest-174125933 None] Delete group completed successfully. Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (9fcec697-83fa-44eb-b306-05e184d92f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338b1ecd-05a1-44b2-b3b5-f45a88ba20bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338b1ecd-05a1-44b2-b3b5-f45a88ba20bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1115545131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e185015-f6fd-4cd6-a915-4047cb064769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:50Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5676a632-ff57-4c16-a2ad-f2b2673635cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5676a632-ff57-4c16-a2ad-f2b2673635cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f227f9-8e33-4aa6-b0cc-93c154bfe4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f227f9-8e33-4aa6-b0cc-93c154bfe4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e185015-f6fd-4cd6-a915-4047cb064769', 'volume_name': 'volume-9e185015-f6fd-4cd6-a915-4047cb064769', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ada90e1-097c-40ed-b53e-d7a1b37ae119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ada90e1-097c-40ed-b53e-d7a1b37ae119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9be1a1f-6d9b-4ac0-a7ce-adddcce483fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:50 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Volume 9e185015-f6fd-4cd6-a915-4047cb064769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e185015-f6fd-4cd6-a915-4047cb064769', 'volume_size': 1} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1115545131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e185015-f6fd-4cd6-a915-4047cb064769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:50Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Creating volume 9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:50 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:50 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 1073741824 Sep 11 13:54:50 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:51 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 1073741824" returned: 0 in 0.579s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:51 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 Sep 11 13:54:51 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:51 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769" returned: 0 in 0.327s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9be1a1f-6d9b-4ac0-a7ce-adddcce483fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e185015-f6fd-4cd6-a915-4047cb064769', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0266a445-61d9-4cde-b98e-cb8ecb52f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:51 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Volume volume-9e185015-f6fd-4cd6-a915-4047cb064769 (9e185015-f6fd-4cd6-a915-4047cb064769): created successfully Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0266a445-61d9-4cde-b98e-cb8ecb52f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (9fcec697-83fa-44eb-b306-05e184d92f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-95b6d607-ac4d-4a24-87ed-9e1dacc915b9 tempest-VolumesSnapshotTestJSON-179182244 None] Created volume successfully. Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Creating offline snapshot 13d7286a-381d-4aed-90be-152102689f88 of volume 9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dce2a4-9cde-421f-9461-9f3020eeb75b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:53 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 Sep 11 13:54:53 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Flow 'volume_create_manager' (a2faa935-a36d-4a56-831d-d0a38edb35aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90df239-a740-4ba2-9fb2-c48c93cfb18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90df239-a740-4ba2-9fb2-c48c93cfb18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1665796172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09b763e-94f7-4284-a56e-5df30246c677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1e90416eb43aeaef515be261d5dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:54Z,use_quota=True,user_id='c4c2088dbb3548489f095e8a2e1a4110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94631fb6-777a-4e73-bc38-856bee4057e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94631fb6-777a-4e73-bc38-856bee4057e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661b852d-cfa1-487e-b0e4-f46f03facfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661b852d-cfa1-487e-b0e4-f46f03facfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09b763e-94f7-4284-a56e-5df30246c677', 'volume_name': 'volume-d09b763e-94f7-4284-a56e-5df30246c677', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d176db5-64de-41db-a4af-60e6f6dcaf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d176db5-64de-41db-a4af-60e6f6dcaf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1f51d-1c85-4cf5-9daf-0314d6f67846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Volume d09b763e-94f7-4284-a56e-5df30246c677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09b763e-94f7-4284-a56e-5df30246c677', 'volume_size': 1} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:53 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769" returned: 0 in 0.521s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:53 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 1G Sep 11 13:54:53 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:54 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 1G" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e185015-f6fd-4cd6-a915-4047cb064769 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:54 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e185015-f6fd-4cd6-a915-4047cb064769 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 Sep 11 13:54:54 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:54 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e185015-f6fd-4cd6-a915-4047cb064769 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:54 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 is being set with open permissions: ugo+rw Sep 11 13:54:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:54 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 Sep 11 13:54:54 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:54 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:54 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info Sep 11 13:54:54 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:55 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:55 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info is being set with open permissions: ugo+rw Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:55 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info Sep 11 13:54:55 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:55 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.info" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1665796172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09b763e-94f7-4284-a56e-5df30246c677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1e90416eb43aeaef515be261d5dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:54Z,use_quota=True,user_id='c4c2088dbb3548489f095e8a2e1a4110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Creating volume d09b763e-94f7-4284-a56e-5df30246c677 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:55 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:55 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 1073741824 Sep 11 13:54:55 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c189a858-781b-47e7-bb87-8cf59ff8ff06 tempest-VolumesSnapshotTestJSON-179182244 None] Create snapshot completed successfully Sep 11 13:54:55 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 1073741824" returned: 0 in 0.476s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:55 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 Sep 11 13:54:55 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:56 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1f51d-1c85-4cf5-9daf-0314d6f67846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09b763e-94f7-4284-a56e-5df30246c677', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121e9b33-e370-4582-81eb-ae2f0eb0cd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Volume volume-d09b763e-94f7-4284-a56e-5df30246c677 (d09b763e-94f7-4284-a56e-5df30246c677): created successfully Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121e9b33-e370-4582-81eb-ae2f0eb0cd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Flow 'volume_create_manager' (a2faa935-a36d-4a56-831d-d0a38edb35aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1a826663-9c95-46f2-9bf1-797d9f6826a4 tempest-AttachVolumeNegativeTest-1005663331 None] Created volume successfully. Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-13d7286a-381d-4aed-90be-152102689f88-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-13d7286a-381d-4aed-90be-152102689f88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-9e185015-f6fd-4cd6-a915-4047cb064769" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-9e185015-f6fd-4cd6-a915-4047cb064769" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-13d7286a-381d-4aed-90be-152102689f88" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-13d7286a-381d-4aed-90be-152102689f88" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Deleting offline snapshot 13d7286a-381d-4aed-90be-152102689f88 of volume 9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] snapshot_file for this snap is: volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a4e32-8c27-45e0-983e-9163e41fd322]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:56 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 Sep 11 13:54:56 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:57 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88" returned: 0 in 0.404s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e185015-f6fd-4cd6-a915-4047cb064769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[002237ad-4816-4d2b-bfd3-232ad28f9c5f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:57 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 Sep 11 13:54:57 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:57 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769" returned: 0 in 0.418s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:57 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 Sep 11 13:54:57 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-b4502307-a217-4b01-9684-05bed07a25d2 req-8fe2c352-b898-48d2-8460-0d42b644245d tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-b4502307-a217-4b01-9684-05bed07a25d2 req-8fe2c352-b898-48d2-8460-0d42b644245d tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-b4502307-a217-4b01-9684-05bed07a25d2 req-8fe2c352-b898-48d2-8460-0d42b644245d tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:57 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-b4502307-a217-4b01-9684-05bed07a25d2 req-8fe2c352-b898-48d2-8460-0d42b644245d tempest-AttachVolumeNegativeTest-1005663331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-d09b763e-94f7-4284-a56e-5df30246c677', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e864688-38c5-4f62-aa4f-45986494e866', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:54:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88" returned: 0 in 0.460s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:58 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88 Sep 11 13:54:58 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:54:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-b4502307-a217-4b01-9684-05bed07a25d2 req-8fe2c352-b898-48d2-8460-0d42b644245d tempest-AttachVolumeNegativeTest-1005663331 None] attachment_update completed successfully. Sep 11 13:54:58 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 11 13:54:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769.13d7286a-381d-4aed-90be-152102689f88" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:54:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-13d7286a-381d-4aed-90be-152102689f88" released by "_delete_snapshot" :: held 1.685s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-9e185015-f6fd-4cd6-a915-4047cb064769" released by "delete_snapshot" :: held 1.719s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:58 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['fc770033-0309-4e7c-b1be-25c6a986e744', '2155e276-847e-4ed8-80d0-0c3bc406bb75', '9848528b-1dcc-423d-af42-ef8220555fb4', '2b55297d-9077-4ed2-a708-4b593205eb75'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:54:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Delete snapshot completed successfully. Sep 11 13:54:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-20a30bfa-497d-4454-8def-de114088bbda tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-13d7286a-381d-4aed-90be-152102689f88-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (04405c89-83bd-4e1b-802f-e65453b85dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578ecc44-062c-4cda-968b-a5366bde3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578ecc44-062c-4cda-968b-a5366bde3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707478420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13475336-4a31-4b95-bb04-466d38ce95cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:59Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649ab6e2-3bd3-47ac-9f9d-4a3c08a32d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649ab6e2-3bd3-47ac-9f9d-4a3c08a32d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc310c1-03cb-4b09-9f4f-c44ef6bac827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc310c1-03cb-4b09-9f4f-c44ef6bac827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13475336-4a31-4b95-bb04-466d38ce95cc', 'volume_name': 'volume-13475336-4a31-4b95-bb04-466d38ce95cc', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641f9f60-1fc6-4021-954e-356fc9098729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641f9f60-1fc6-4021-954e-356fc9098729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240906d1-9d81-4d14-b440-91edbd5446ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:54:59 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Volume 13475336-4a31-4b95-bb04-466d38ce95cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13475336-4a31-4b95-bb04-466d38ce95cc', 'volume_size': 1} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707478420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13475336-4a31-4b95-bb04-466d38ce95cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:54:59Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Creating volume 13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:54:59 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:54:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:54:59 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc 1073741824 Sep 11 13:54:59 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:00 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc 1073741824" returned: 0 in 0.569s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=117,cinder:UPDATE=101,cinder:INSERT=25,cinder:DELETE=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:00 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc Sep 11 13:55:00 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:00 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc" returned: 0 in 0.308s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240906d1-9d81-4d14-b440-91edbd5446ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13475336-4a31-4b95-bb04-466d38ce95cc', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3622c629-2dcc-4b43-b5ae-307c00b3dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:00 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Volume volume-13475336-4a31-4b95-bb04-466d38ce95cc (13475336-4a31-4b95-bb04-466d38ce95cc): created successfully Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3622c629-2dcc-4b43-b5ae-307c00b3dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (04405c89-83bd-4e1b-802f-e65453b85dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9641d465-347c-4b27-863a-ecea50767e44 tempest-VolumesSnapshotTestJSON-179182244 None] Created volume successfully. Sep 11 13:55:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9bd2785b-f5cd-4919-9680-aad060b819ba tempest-GroupsV314Test-1102615619 None] Group tempest-GroupsV314Test-Group-1641196379: creating Sep 11 13:55:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9bd2785b-f5cd-4919-9680-aad060b819ba tempest-GroupsV314Test-1102615619 None] Group tempest-GroupsV314Test-Group-1641196379: created successfully Sep 11 13:55:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-7eda1cbe-c04a-498e-8d16-d6d5b38cf8fa req-42bdde6a-767f-4905-9c2b-21a498c86177 tempest-AttachVolumeNegativeTest-1005663331 None] Terminate volume connection completed successfully. Sep 11 13:55:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-7eda1cbe-c04a-498e-8d16-d6d5b38cf8fa req-42bdde6a-767f-4905-9c2b-21a498c86177 tempest-AttachVolumeNegativeTest-1005663331 None] Deleting attachment 7e864688-38c5-4f62-aa4f-45986494e866. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:55:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9bd2785b-f5cd-4919-9680-aad060b819ba tempest-GroupsV314Test-1102615619 None] Create group completed successfully. Sep 11 13:55:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Creating offline snapshot a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 of volume 13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:55:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87b99c-ca21-4395-b2f0-5a87863e9851]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:01 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc Sep 11 13:55:01 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:02 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc" returned: 0 in 0.435s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:02 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 1G Sep 11 13:55:02 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:02 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 1G" returned: 0 in 0.631s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13475336-4a31-4b95-bb04-466d38ce95cc -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:02 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13475336-4a31-4b95-bb04-466d38ce95cc -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 Sep 11 13:55:02 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Flow 'volume_create_manager' (6f36a42b-bd16-4ce0-875e-213b52aa4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aec9bb9-7c1a-45f2-9247-dea0ca9d0abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aec9bb9-7c1a-45f2-9247-dea0ca9d0abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318947750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13e956b4-4527-4ad5-8bd3-a3eb4f88eec7,host='devstack@QuobyteHD#QuobyteHD',id=ebdf0527-7bc0-4844-a2d7-2f210c2fa3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e54a1d04ec54fefbdde1b4a3ff15b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:03Z,use_quota=True,user_id='e6993547eb8948ba8e4665cb6d25193d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef9249e5-7ace-4f4e-b5ab-ac1ec47990b7),volume_type_id=ef9249e5-7ace-4f4e-b5ab-ac1ec47990b7)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc051651-8d38-43a4-a1a1-b3d85820e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc051651-8d38-43a4-a1a1-b3d85820e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41efc348-0547-455c-a261-82fd5eb518f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41efc348-0547-455c-a261-82fd5eb518f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdf0527-7bc0-4844-a2d7-2f210c2fa3be', 'volume_name': 'volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add241a3-0272-4fde-9df0-7e8708fefc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add241a3-0272-4fde-9df0-7e8708fefc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45082c67-a96e-495b-a540-27ee75730d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Volume ebdf0527-7bc0-4844-a2d7-2f210c2fa3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be', 'volume_size': 1} Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:03 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13475336-4a31-4b95-bb04-466d38ce95cc -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:03 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 is being set with open permissions: ugo+rw Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:03 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 Sep 11 13:55:03 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:03 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:03 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info Sep 11 13:55:03 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:03 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info" returned: 0 in 0.321s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:03 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info is being set with open permissions: ugo+rw Sep 11 13:55:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:03 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info Sep 11 13:55:03 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:04 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.info" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13e956b4-4527-4ad5-8bd3-a3eb4f88eec7,created_at=2026-09-11T11:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318947750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13e956b4-4527-4ad5-8bd3-a3eb4f88eec7,host='devstack@QuobyteHD#QuobyteHD',id=ebdf0527-7bc0-4844-a2d7-2f210c2fa3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e54a1d04ec54fefbdde1b4a3ff15b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:03Z,use_quota=True,user_id='e6993547eb8948ba8e4665cb6d25193d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef9249e5-7ace-4f4e-b5ab-ac1ec47990b7),volume_type_id=ef9249e5-7ace-4f4e-b5ab-ac1ec47990b7)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Creating volume ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:04 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:04 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be 1073741824 Sep 11 13:55:04 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0bf2172a-91aa-49b7-b0c3-f05acbf25ddc tempest-VolumesSnapshotTestJSON-179182244 None] Create snapshot completed successfully Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Flow 'volume_create_manager' (bed474e9-7e97-42a6-a444-208a3a60b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337f5f18-b2fd-419b-b882-f57b48666b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337f5f18-b2fd-419b-b882-f57b48666b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-765613253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc78464f-294f-49f8-9e8c-53a6139c45b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e320347abe8a479a97c966e97f61bf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:04Z,use_quota=True,user_id='073556cbde6449bfbc7bf49c1fb3e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041b1022-26c1-437f-b9aa-9f688b01dc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041b1022-26c1-437f-b9aa-9f688b01dc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c665fc9b-1135-427d-a1cd-4a1dbde0e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c665fc9b-1135-427d-a1cd-4a1dbde0e80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc78464f-294f-49f8-9e8c-53a6139c45b0', 'volume_name': 'volume-bc78464f-294f-49f8-9e8c-53a6139c45b0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d007c6-4e64-45c7-83a4-7a7bc8cc7a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d007c6-4e64-45c7-83a4-7a7bc8cc7a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1ee26-2f9a-4547-b3a8-d185c70f583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Volume bc78464f-294f-49f8-9e8c-53a6139c45b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc78464f-294f-49f8-9e8c-53a6139c45b0', 'volume_size': 1} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:04 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be 1073741824" returned: 0 in 0.509s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:04 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be Sep 11 13:55:04 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:05 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" returned: 0 in 0.282s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-765613253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc78464f-294f-49f8-9e8c-53a6139c45b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e320347abe8a479a97c966e97f61bf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:04Z,use_quota=True,user_id='073556cbde6449bfbc7bf49c1fb3e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Creating volume bc78464f-294f-49f8-9e8c-53a6139c45b0 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45082c67-a96e-495b-a540-27ee75730d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 1073741824 Sep 11 13:55:05 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437cbfb0-6aa4-4f5e-9aaa-742519b95248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Volume volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be (ebdf0527-7bc0-4844-a2d7-2f210c2fa3be): created successfully Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437cbfb0-6aa4-4f5e-9aaa-742519b95248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Flow 'volume_create_manager' (6f36a42b-bd16-4ce0-875e-213b52aa4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-11156056-e30d-4c9c-8450-6ec4afd54df9 tempest-GroupsV314Test-1102615619 None] Created volume successfully. Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (d502d98b-d9e5-46c3-b57b-a194d02511dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5d0abc-bf4b-47e7-b783-8e37e43be746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5d0abc-bf4b-47e7-b783-8e37e43be746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1252401664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72ba50a-b14d-4803-956e-cd5e40cd7f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a8cf18bc-7e6c-4669-b2ce-5efd405b93b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:05Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586c51b5-d2cf-42a3-aa7e-516690037409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586c51b5-d2cf-42a3-aa7e-516690037409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a63253-3be9-4e28-8a18-e0be3ef189e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a63253-3be9-4e28-8a18-e0be3ef189e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd72ba50a-b14d-4803-956e-cd5e40cd7f9d', 'volume_name': 'volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d', 'volume_size': 2, 'snapshot_id': 'a8cf18bc-7e6c-4669-b2ce-5efd405b93b4'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6675c9-b116-4718-90d3-5b26d59beefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6675c9-b116-4718-90d3-5b26d59beefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd7b715-e9ed-4398-b9a3-4bfdefd3a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Volume d72ba50a-b14d-4803-956e-cd5e40cd7f9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d', 'volume_size': 2, 'snapshot_id': 'a8cf18bc-7e6c-4669-b2ce-5efd405b93b4'} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:05 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 1073741824" returned: 0 in 0.541s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:05 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 Sep 11 13:55:05 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:05 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.367s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1ee26-2f9a-4547-b3a8-d185c70f583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc78464f-294f-49f8-9e8c-53a6139c45b0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2dc809-9f67-448e-a554-48303e16ce21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Creating volume d72ba50a-b14d-4803-956e-cd5e40cd7f9d from snapshot a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Volume volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 (bc78464f-294f-49f8-9e8c-53a6139c45b0): created successfully Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2dc809-9f67-448e-a554-48303e16ce21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Flow 'volume_create_manager' (bed474e9-7e97-42a6-a444-208a3a60b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] snapshot: a8cf18bc-7e6c-4669-b2ce-5efd405b93b4, volume: d72ba50a-b14d-4803-956e-cd5e40cd7f9d, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:55:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5513888e-77b2-4139-9b8a-03b7f437e516 tempest-AttachVolumeTestJSON-1734396399 None] Created volume successfully. Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8af14-73c7-495c-b666-1a74383eb786]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:06 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 Sep 11 13:55:06 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:06 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" returned: 0 in 0.525s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13475336-4a31-4b95-bb04-466d38ce95cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eae059-3ee1-45a4-8d46-4bea25fa3cb2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:06 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc Sep 11 13:55:06 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:07 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc" returned: 0 in 0.441s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:07 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d Sep 11 13:55:07 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "cinder-d09b763e-94f7-4284-a56e-5df30246c677-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-d09b763e-94f7-4284-a56e-5df30246c677-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "cinder-quobyte-d09b763e-94f7-4284-a56e-5df30246c677" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-quobyte-d09b763e-94f7-4284-a56e-5df30246c677" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8f933-bd66-42c2-b0c4-885c49be79dd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c4e94478-0f70-439d-a599-12a370cde33b req-4b93f03a-c879-470b-ac78-ef0245cf5efa tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:07 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 Sep 11 13:55:07 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:07 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677" returned: 0 in 0.544s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:07 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677 Sep 11 13:55:07 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:08 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d09b763e-94f7-4284-a56e-5df30246c677" returned: 0 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-quobyte-d09b763e-94f7-4284-a56e-5df30246c677" released by "delete_volume" :: held 1.027s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Created reservations ['14b8d55c-06c8-4c95-8ae2-ef7d1873f1f4', '0da4fcdd-be2b-4f8b-8404-f7350dad9dfb', '60045a45-212e-4b26-b399-fc603da97cb8', '351a3684-3067-4595-a976-7bee7f7217fa'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:08 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:08 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:08 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.376s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Deleted volume successfully. Sep 11 13:55:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-482424e3-13ba-418d-bfff-9a0576abea92 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-d09b763e-94f7-4284-a56e-5df30246c677-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "cinder-42655d95-d5b3-493a-9ecd-a757baed3c9a-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-42655d95-d5b3-493a-9ecd-a757baed3c9a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "cinder-quobyte-42655d95-d5b3-493a-9ecd-a757baed3c9a" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-quobyte-42655d95-d5b3-493a-9ecd-a757baed3c9a" acquired by "delete_volume" :: waited 0.045s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:09 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[68608d0e-c94f-4fab-9a68-acbb3686320f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:10 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a Sep 11 13:55:10 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:10 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a" returned: 0 in 0.670s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:10 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:10 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:10 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a Sep 11 13:55:10 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:11 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-42655d95-d5b3-493a-9ecd-a757baed3c9a" returned: 0 in 0.480s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-quobyte-42655d95-d5b3-493a-9ecd-a757baed3c9a" released by "delete_volume" :: held 1.234s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Created reservations ['bbcef590-435b-45d6-8034-254485e6552e', '718ada47-e2dd-42f6-b293-7716fe474563', '0aec8334-4ac8-4914-92ff-ff2675f38d02', 'f15ff7a8-b933-4094-88e4-916b04d05ecf'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:11 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.646s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:11 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:11 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:11 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.463s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:11 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Deleted volume successfully. Sep 11 13:55:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2b4a46a0-dbd2-41eb-93a7-b75c91f7ff05 tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-42655d95-d5b3-493a-9ecd-a757baed3c9a-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:12 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" returned: 0 in 5.052s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:55:12 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Converted 1024.00 MB image at 202.64 MB/s Sep 11 13:55:12 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d is being set with open permissions: ugo+rw Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:12 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d Sep 11 13:55:12 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:12 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" returned: 0 in 0.231s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" released by "_copy_volume_from_snapshot" :: held 6.356s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "cinder-dd2d4737-be50-4007-a36c-131c93c8e6ef-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-dd2d4737-be50-4007-a36c-131c93c8e6ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "cinder-quobyte-dd2d4737-be50-4007-a36c-131c93c8e6ef" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" released by "_create_volume_from_snapshot" :: held 6.484s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.513s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.288s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:12 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Cloning volume ebdf0527-7bc0-4844-a2d7-2f210c2fa3be to volume 902f0463-b572-4345-a152-0fdb058b3742 Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-quobyte-dd2d4737-be50-4007-a36c-131c93c8e6ef" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[06411e6b-c13a-4472-a850-74cdcc5e91d2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd7b715-e9ed-4398-b9a3-4bfdefd3a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d', 'volume_size': 2, 'snapshot_id': 'a8cf18bc-7e6c-4669-b2ce-5efd405b93b4'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dcbf81-4930-4b72-a556-57770ca8031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Creating offline snapshot 73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 of volume ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:55:12 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Volume volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d (d72ba50a-b14d-4803-956e-cd5e40cd7f9d): created successfully Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dcbf81-4930-4b72-a556-57770ca8031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (d502d98b-d9e5-46c3-b57b-a194d02511dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed22dd-1eb8-4473-b70e-5b607f05409f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-49f740f2-c98f-4bf9-98c4-3f4362d71d03 tempest-VolumesSnapshotTestJSON-179182244 None] Created volume successfully. Sep 11 13:55:12 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef Sep 11 13:55:12 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:12 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be Sep 11 13:55:12 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:12 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef" returned: 0 in 0.371s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:12 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef Sep 11 13:55:12 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:12 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" returned: 0 in 0.381s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:12 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 1G Sep 11 13:55:12 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:13 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd2d4737-be50-4007-a36c-131c93c8e6ef" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-quobyte-dd2d4737-be50-4007-a36c-131c93c8e6ef" released by "delete_volume" :: held 0.677s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Created reservations ['a5d7805a-dde9-44c5-a800-a128f99a492f', 'c7a981a6-3480-43a8-a611-10919c9285e2', '71aea6a1-3d2d-4aef-bdf8-f0e10380eafd', '9b7f68f3-c30b-4d86-b75b-5db5db151974'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-d72ba50a-b14d-4803-956e-cd5e40cd7f9d-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-d72ba50a-b14d-4803-956e-cd5e40cd7f9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:13 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:13 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be116654-667c-499d-86d5-f246514dc894]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:13 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 1G" returned: 0 in 0.443s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:13 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 Sep 11 13:55:13 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:13 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d Sep 11 13:55:13 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:13 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Deleted volume successfully. Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36c55323-573e-4eb8-a5c9-303e50fa4ebf tempest-AttachVolumeNegativeTest-1005663331 None] Lock "cinder-dd2d4737-be50-4007-a36c-131c93c8e6ef-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:13 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" returned: 0 in 0.345s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:13 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:13 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:13 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 Sep 11 13:55:13 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:13 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d Sep 11 13:55:13 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:13 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" returned: 0 in 0.268s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:14 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:14 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info Sep 11 13:55:14 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-d72ba50a-b14d-4803-956e-cd5e40cd7f9d" released by "delete_volume" :: held 0.745s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['917dd963-6bd1-4318-bb0c-5ab04a704500', '9d7361a4-d69b-43b8-936c-fdcfb0c4fd6b', 'd2cf4239-d663-491a-84f4-0dc40f220374', '72e726f2-c4e8-4b00-9a32-ddd7d8eaf2ca'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:14 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:14 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:14 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:14 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:14 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info Sep 11 13:55:14 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-13475336-4a31-4b95-bb04-466d38ce95cc" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-13475336-4a31-4b95-bb04-466d38ce95cc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:14 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Deleting offline snapshot a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 of volume 13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] snapshot_file for this snap is: volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.407s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Deleted volume successfully. Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b49897-5dcf-44f2-a137-ca834955f09f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f2fe2bca-8349-42cf-9107-a23c4c582af8 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-d72ba50a-b14d-4803-956e-cd5e40cd7f9d-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:14 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.info" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Acquiring lock "cinder-quobyte-902f0463-b572-4345-a152-0fdb058b3742" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-902f0463-b572-4345-a152-0fdb058b3742" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] snapshot: 73ce30be-2089-4a4b-9b61-5c8bbbcf2d16, volume: 902f0463-b572-4345-a152-0fdb058b3742, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ad2933-ad7f-4c2a-b19b-5aa2bfde7439]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:14 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 Sep 11 13:55:14 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:14 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 Sep 11 13:55:14 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:14 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" returned: 0 in 0.402s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13475336-4a31-4b95-bb04-466d38ce95cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f3b8e-b04d-4ada-bfd7-011b092fdb9c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:15 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" returned: 0 in 0.408s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4adbdcf-98db-4cc1-8f75-f91a57b1695b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:15 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc Sep 11 13:55:15 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:15 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be Sep 11 13:55:15 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:15 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" returned: 0 in 0.427s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:15 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:15 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 Sep 11 13:55:15 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc" returned: 0 in 0.586s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:15 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 Sep 11 13:55:15 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:15 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" returned: 0 in 0.380s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:16 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4 Sep 11 13:55:16 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:16 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc.a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" returned: 0 in 0.601s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4" released by "_delete_snapshot" :: held 2.178s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-13475336-4a31-4b95-bb04-466d38ce95cc" released by "delete_snapshot" :: held 2.230s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['4dd2e32e-a597-46f7-9160-719550a11327', '492ac74d-4490-4dc7-b37a-7cf0ea80aa30', 'b54dcd14-c727-4666-88ab-45db38cb9309', '3091af2f-08ba-465d-a371-b2640ddc8289'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Delete snapshot completed successfully. Sep 11 13:55:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ff6387b-d7ec-414c-a0be-38c5b256fd5e tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-a8cf18bc-7e6c-4669-b2ce-5efd405b93b4-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-13475336-4a31-4b95-bb04-466d38ce95cc-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-13475336-4a31-4b95-bb04-466d38ce95cc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-13475336-4a31-4b95-bb04-466d38ce95cc" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-13475336-4a31-4b95-bb04-466d38ce95cc" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15059fb-11f6-4e73-91cb-4e4d36829bf7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:19 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc Sep 11 13:55:19 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:19 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc" returned: 0 in 1.006s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:19 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc Sep 11 13:55:19 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:20 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13475336-4a31-4b95-bb04-466d38ce95cc" returned: 0 in 0.452s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-13475336-4a31-4b95-bb04-466d38ce95cc" released by "delete_volume" :: held 1.655s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['aa03e1e4-9594-4884-9df1-c161dbd3642e', 'd082a1a2-f01a-40e2-bad9-7094c0ab6c0a', '4baa31ec-2f32-475b-a596-7f9f0f22df31', '37908f13-c858-4aab-85ce-70f1d29a6aef'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:20 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:20 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:20 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:20 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Deleted volume successfully. Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8675c8b8-0241-4c94-adc7-490f2fe1e65b tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-13475336-4a31-4b95-bb04-466d38ce95cc-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:21 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742" returned: 0 in 5.856s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:55:21 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Converted 1024.00 MB image at 174.84 MB/s Sep 11 13:55:21 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:21 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 Sep 11 13:55:21 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:21 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-902f0463-b572-4345-a152-0fdb058b3742" released by "_copy_volume_from_snapshot" :: held 7.067s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Acquiring lock "cinder-quobyte-73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Deleting offline snapshot 73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 of volume ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] snapshot_file for this snap is: volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f750cb-f5d2-4791-8f04-1438fe8d1115]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:21 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 Sep 11 13:55:21 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (bafc2f3e-79d5-419f-a337-d7e4a27bd404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ca85c4-f5d4-4882-ab12-43c003e8f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ca85c4-f5d4-4882-ab12-43c003e8f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1233278307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bf83ef-6464-4e91-b696-c1b535f420b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:22Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2de6b6-b27a-4909-801b-a329699c1bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2de6b6-b27a-4909-801b-a329699c1bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068a7cb2-7118-47a3-b949-0ca30bf95f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068a7cb2-7118-47a3-b949-0ca30bf95f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69bf83ef-6464-4e91-b696-c1b535f420b2', 'volume_name': 'volume-69bf83ef-6464-4e91-b696-c1b535f420b2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465c2f58-7708-46c3-9876-c2002b7fcb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465c2f58-7708-46c3-9876-c2002b7fcb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6400a908-457c-402a-9fda-0b0a79eea568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:22 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Volume 69bf83ef-6464-4e91-b696-c1b535f420b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69bf83ef-6464-4e91-b696-c1b535f420b2', 'volume_size': 1} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:22 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" returned: 0 in 0.415s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15ce4ae-9139-48a2-9cb6-e3a873bda474]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:22 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be Sep 11 13:55:22 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:22 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" returned: 0 in 0.535s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:22 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 Sep 11 13:55:22 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:23 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" returned: 0 in 0.339s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:23 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16 Sep 11 13:55:23 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:23 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be.73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" returned: 0 in 0.274s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-73ce30be-2089-4a4b-9b61-5c8bbbcf2d16" released by "_delete_snapshot" :: held 1.665s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.042s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c4e94478-0f70-439d-a599-12a370cde33b req-4b93f03a-c879-470b-ac78-ef0245cf5efa tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.232s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c4e94478-0f70-439d-a599-12a370cde33b req-4b93f03a-c879-470b-ac78-ef0245cf5efa tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1233278307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bf83ef-6464-4e91-b696-c1b535f420b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:22Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Creating volume 69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:23 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:23 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 1073741824 Sep 11 13:55:23 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c4e94478-0f70-439d-a599-12a370cde33b req-4b93f03a-c879-470b-ac78-ef0245cf5efa tempest-AttachVolumeTestJSON-1734396399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-bc78464f-294f-49f8-9e8c-53a6139c45b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3719065-bd29-465e-8c0a-6b37a7cf1699', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:55:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-61e0899e-37e1-47dc-a3a3-1ea1586eaad1 tempest-GroupsV314Test-1102615619 None] Create group from source-group-13e956b4-4527-4ad5-8bd3-a3eb4f88eec7 completed successfully. Sep 11 13:55:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-c4e94478-0f70-439d-a599-12a370cde33b req-4b93f03a-c879-470b-ac78-ef0245cf5efa tempest-AttachVolumeTestJSON-1734396399 None] attachment_update completed successfully. Sep 11 13:55:24 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 1073741824" returned: 0 in 0.551s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:24 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 Sep 11 13:55:24 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:24 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2" returned: 0 in 0.323s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6400a908-457c-402a-9fda-0b0a79eea568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69bf83ef-6464-4e91-b696-c1b535f420b2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90438475-d18e-463a-a3f3-558feb4d7240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:24 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Volume volume-69bf83ef-6464-4e91-b696-c1b535f420b2 (69bf83ef-6464-4e91-b696-c1b535f420b2): created successfully Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90438475-d18e-463a-a3f3-558feb4d7240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (bafc2f3e-79d5-419f-a337-d7e4a27bd404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:24 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-825af71b-d8b1-443d-b356-3cbf375c0df4 tempest-VolumesSnapshotTestJSON-179182244 None] Created volume successfully. Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Acquiring lock "cinder-quobyte-902f0463-b572-4345-a152-0fdb058b3742" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-902f0463-b572-4345-a152-0fdb058b3742" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b33671-4a0a-436f-9fcd-b2605d24e0eb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:25 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 Sep 11 13:55:25 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Creating offline snapshot 2a934481-f989-4a5a-afaa-6c03bf6f3ce4 of volume 69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:55:25 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742" returned: 0 in 0.413s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb9852-2a1e-4361-a758-6cf196470416]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:25 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742 Sep 11 13:55:25 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:25 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 Sep 11 13:55:25 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7b57f9f1-6135-4780-8bbe-50517686da9c tempest-GroupSnapshotsV319Test-376253594 None] Group tempest-GroupSnapshotsV319Test-Group-1002813889: creating Sep 11 13:55:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7b57f9f1-6135-4780-8bbe-50517686da9c tempest-GroupSnapshotsV319Test-376253594 None] Group tempest-GroupSnapshotsV319Test-Group-1002813889: created successfully Sep 11 13:55:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7b57f9f1-6135-4780-8bbe-50517686da9c tempest-GroupSnapshotsV319Test-376253594 None] Create group completed successfully. Sep 11 13:55:25 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-902f0463-b572-4345-a152-0fdb058b3742" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-902f0463-b572-4345-a152-0fdb058b3742" released by "delete_volume" :: held 0.815s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Created reservations ['fa77ec14-c96f-496b-8a0d-d6ef27bf41f3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:25 devstack cinder-volume[88731]: WARNING cinder.quota [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-954776915 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-954776915, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:55:25 devstack cinder-volume[88731]: WARNING cinder.quota [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-954776915 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-954776915, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Created reservations ['04041460-e954-4bb4-a58d-347ea5d8e238', 'b2fbec76-8016-4161-86d2-a9d3b9faac94', '535a25f3-135f-4fa1-8bff-fb27440dbe3d', '5beb1e37-707b-4ce1-ad47-7e5fba56dc95'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:25 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2" returned: 0 in 0.561s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:25 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 1G Sep 11 13:55:25 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:26 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:26 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:26 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.434s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:26 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0c448a37-a80a-4b4a-a90f-032d35b29ab1 tempest-GroupsV314Test-1102615619 None] Delete group completed successfully. Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Flow 'volume_create_manager' (f3da4222-6fb8-448f-a9f1-967246df9619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1aed76-e4de-4889-85c7-44865b687379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1aed76-e4de-4889-85c7-44865b687379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1225869644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31868910-2c17-46c6-b39a-2c9ae8de9e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e320347abe8a479a97c966e97f61bf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:26Z,use_quota=True,user_id='073556cbde6449bfbc7bf49c1fb3e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1695db3-3dc3-4f0b-89c2-7293e9d2c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1695db3-3dc3-4f0b-89c2-7293e9d2c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ea0bfb-e216-436d-a7fe-dab45ac8563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ea0bfb-e216-436d-a7fe-dab45ac8563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31868910-2c17-46c6-b39a-2c9ae8de9e37', 'volume_name': 'volume-31868910-2c17-46c6-b39a-2c9ae8de9e37', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a34092-35f5-45a4-8a29-a0b5eb034b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a34092-35f5-45a4-8a29-a0b5eb034b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708907bb-43b3-44a0-8805-747ee0388dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Volume 31868910-2c17-46c6-b39a-2c9ae8de9e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31868910-2c17-46c6-b39a-2c9ae8de9e37', 'volume_size': 1} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:26 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 1G" returned: 0 in 0.788s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69bf83ef-6464-4e91-b696-c1b535f420b2 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Acquiring lock "cinder-quobyte-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:26 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69bf83ef-6464-4e91-b696-c1b535f420b2 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 Sep 11 13:55:26 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63859e70-72f7-4f04-afd7-7591d4295e75]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:26 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be Sep 11 13:55:26 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:27 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69bf83ef-6464-4e91-b696-c1b535f420b2 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4" returned: 0 in 0.357s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:27 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 is being set with open permissions: ugo+rw Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:27 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 Sep 11 13:55:27 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:27 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" returned: 0 in 0.420s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:27 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be Sep 11 13:55:27 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Flow 'volume_create_manager' (ebb3afd7-b1bc-4967-8f0c-f3c9c6699416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39023b38-e410-4b03-ae6b-8fc75730e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39023b38-e410-4b03-ae6b-8fc75730e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2141250506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a342b98-cf45-4d92-9699-6a1a99dd1359,host='devstack@QuobyteHD#QuobyteHD',id=260b8671-c222-43db-82c2-6e1f1453c0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6044414ee54611a08128a96baa5c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:27Z,use_quota=True,user_id='ee51bf994bfe4b5392c94303cf2f6ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c4650fc-1876-4238-9db5-089c124378cf),volume_type_id=1c4650fc-1876-4238-9db5-089c124378cf)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb4b502-838f-4a1f-a80e-2fe97d310b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb4b502-838f-4a1f-a80e-2fe97d310b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddefd11-1a22-45d6-adb6-4dfc8bfeb722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddefd11-1a22-45d6-adb6-4dfc8bfeb722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260b8671-c222-43db-82c2-6e1f1453c0e6', 'volume_name': 'volume-260b8671-c222-43db-82c2-6e1f1453c0e6', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7c1473-c0f6-4c96-aeee-5852d2583da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7c1473-c0f6-4c96-aeee-5852d2583da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f2775a-d03b-49af-959b-f51cedfcdca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:27 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Volume 260b8671-c222-43db-82c2-6e1f1453c0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260b8671-c222-43db-82c2-6e1f1453c0e6', 'volume_size': 1} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:27 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4" returned: 0 in 0.324s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:27 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info Sep 11 13:55:27 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:27 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" returned: 0 in 0.275s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Lock "cinder-quobyte-ebdf0527-7bc0-4844-a2d7-2f210c2fa3be" released by "delete_volume" :: held 0.765s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Created reservations ['bf80aa1a-c4a6-4da5-a8b4-3a892179c491'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Created reservations ['d910d26a-3116-48d5-a2de-6aebbbc1d96f', 'fb72aaee-dec4-45c0-8891-c50dce50ab4e', '852e74dd-a08c-4e15-a38e-c2a6a4ed198d', 'f288003b-cd48-4279-a26e-8cf4c1edd7bd'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:27 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:27 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info is being set with open permissions: ugo+rw Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:27 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:27 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:27 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info Sep 11 13:55:27 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:27 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:27 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2a31e4dd-ef4d-4d33-859f-6e440385719a tempest-GroupsV314Test-1102615619 None] Delete group completed successfully. Sep 11 13:55:28 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.info" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1225869644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31868910-2c17-46c6-b39a-2c9ae8de9e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e320347abe8a479a97c966e97f61bf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:26Z,use_quota=True,user_id='073556cbde6449bfbc7bf49c1fb3e02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Creating volume 31868910-2c17-46c6-b39a-2c9ae8de9e37 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:28 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:28 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 1073741824 Sep 11 13:55:28 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-684ec26a-a971-4885-8b43-c2ee45eca9ba tempest-VolumesSnapshotTestJSON-179182244 None] Create snapshot completed successfully Sep 11 13:55:28 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 1073741824" returned: 0 in 0.472s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:28 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 Sep 11 13:55:28 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:28 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37" returned: 0 in 0.258s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a342b98-cf45-4d92-9699-6a1a99dd1359,created_at=2026-09-11T11:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2141250506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a342b98-cf45-4d92-9699-6a1a99dd1359,host='devstack@QuobyteHD#QuobyteHD',id=260b8671-c222-43db-82c2-6e1f1453c0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6044414ee54611a08128a96baa5c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:27Z,use_quota=True,user_id='ee51bf994bfe4b5392c94303cf2f6ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c4650fc-1876-4238-9db5-089c124378cf),volume_type_id=1c4650fc-1876-4238-9db5-089c124378cf)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Creating volume 260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:28 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708907bb-43b3-44a0-8805-747ee0388dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31868910-2c17-46c6-b39a-2c9ae8de9e37', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500111fd-4436-476f-9113-3b3a59c0f79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:28 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 1073741824 Sep 11 13:55:28 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Volume volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 (31868910-2c17-46c6-b39a-2c9ae8de9e37): created successfully Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500111fd-4436-476f-9113-3b3a59c0f79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Flow 'volume_create_manager' (f3da4222-6fb8-448f-a9f1-967246df9619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3ca84d03-6deb-47ea-b107-efaacf4452f5 tempest-AttachVolumeTestJSON-1734396399 None] Created volume successfully. Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (95ccd804-73ad-4167-9fa2-1e8c7c55ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a053fc78-d785-4abd-a1dc-e77aa4fb0e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a053fc78-d785-4abd-a1dc-e77aa4fb0e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1515145093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18a8308-a5a2-4541-a2df-9cb8d469460d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990d6ba8d3cd479b902355e481ba6b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a934481-f989-4a5a-afaa-6c03bf6f3ce4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:29Z,use_quota=True,user_id='977d58ccb9004b94b49e0104b11c479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907f59d-22d3-4d5c-b1b5-33247101747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907f59d-22d3-4d5c-b1b5-33247101747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63d3d99-9a01-4559-895e-667333c7297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63d3d99-9a01-4559-895e-667333c7297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f18a8308-a5a2-4541-a2df-9cb8d469460d', 'volume_name': 'volume-f18a8308-a5a2-4541-a2df-9cb8d469460d', 'volume_size': 1, 'snapshot_id': '2a934481-f989-4a5a-afaa-6c03bf6f3ce4'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f1edd4-88d9-483c-ba3a-cbec8f321f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f1edd4-88d9-483c-ba3a-cbec8f321f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3fa64a-24d9-41a8-8980-a455204668a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Volume f18a8308-a5a2-4541-a2df-9cb8d469460d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f18a8308-a5a2-4541-a2df-9cb8d469460d', 'volume_size': 1, 'snapshot_id': '2a934481-f989-4a5a-afaa-6c03bf6f3ce4'} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:29 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 1073741824" returned: 0 in 0.518s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:29 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 Sep 11 13:55:29 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:29 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.422s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-2a934481-f989-4a5a-afaa-6c03bf6f3ce4-f18a8308-a5a2-4541-a2df-9cb8d469460d" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-2a934481-f989-4a5a-afaa-6c03bf6f3ce4-f18a8308-a5a2-4541-a2df-9cb8d469460d" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Creating volume f18a8308-a5a2-4541-a2df-9cb8d469460d from snapshot 2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-f18a8308-a5a2-4541-a2df-9cb8d469460d" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f2775a-d03b-49af-959b-f51cedfcdca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260b8671-c222-43db-82c2-6e1f1453c0e6', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd93d25e-db53-4313-ada7-8a97bdd31915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-f18a8308-a5a2-4541-a2df-9cb8d469460d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] snapshot: 2a934481-f989-4a5a-afaa-6c03bf6f3ce4, volume: f18a8308-a5a2-4541-a2df-9cb8d469460d, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Volume volume-260b8671-c222-43db-82c2-6e1f1453c0e6 (260b8671-c222-43db-82c2-6e1f1453c0e6): created successfully Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd93d25e-db53-4313-ada7-8a97bdd31915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Flow 'volume_create_manager' (ebb3afd7-b1bc-4967-8f0c-f3c9c6699416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c309d03-0923-4304-8d7d-5c9c4dbdb411]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7bb83c5b-3d9b-4d7e-a47c-b068bdbfb2b2 tempest-GroupSnapshotsV319Test-376253594 None] Created volume successfully. Sep 11 13:55:29 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 Sep 11 13:55:29 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:30 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4" returned: 0 in 0.454s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69bf83ef-6464-4e91-b696-c1b535f420b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b7f7fa-35b0-4ba4-b89c-6864de0ae119]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:30 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 Sep 11 13:55:30 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-58a352b5-b48a-4479-a7eb-302934e64815 req-d5367862-c8a2-4cc0-ac0a-8207e4262af0 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:30 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2" returned: 0 in 0.451s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:55:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:30 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d Sep 11 13:55:30 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] GroupSnapshot 9076641b-bdeb-4eee-bd7f-dd5a27dcc384: creating. Sep 11 13:55:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Group snapshot 9076641b-bdeb-4eee-bd7f-dd5a27dcc384: creating. {{(pid=88731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 13:55:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:35 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d" returned: 0 in 4.884s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:55:35 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Converted 1024.00 MB image at 209.61 MB/s Sep 11 13:55:35 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d is being set with open permissions: ugo+rw Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:35 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d Sep 11 13:55:35 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:35 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d" returned: 0 in 0.258s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-f18a8308-a5a2-4541-a2df-9cb8d469460d" released by "_copy_volume_from_snapshot" :: held 6.151s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-2a934481-f989-4a5a-afaa-6c03bf6f3ce4-f18a8308-a5a2-4541-a2df-9cb8d469460d" released by "_create_volume_from_snapshot" :: held 6.238s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.275s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-58a352b5-b48a-4479-a7eb-302934e64815 req-d5367862-c8a2-4cc0-ac0a-8207e4262af0 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.364s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-58a352b5-b48a-4479-a7eb-302934e64815 req-d5367862-c8a2-4cc0-ac0a-8207e4262af0 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.769s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Creating offline snapshot 951e6d75-be09-4b98-9a4b-e4b6b30a95bc of volume 260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3fa64a-24d9-41a8-8980-a455204668a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18a8308-a5a2-4541-a2df-9cb8d469460d', 'volume_size': 1, 'snapshot_id': '2a934481-f989-4a5a-afaa-6c03bf6f3ce4'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d7d3bd-26c2-466d-83e6-91eee261faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4173b61d-c58b-492c-8b2c-6c427ca11781]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:36 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Volume volume-f18a8308-a5a2-4541-a2df-9cb8d469460d (f18a8308-a5a2-4541-a2df-9cb8d469460d): created successfully Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d7d3bd-26c2-466d-83e6-91eee261faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Flow 'volume_create_manager' (95ccd804-73ad-4167-9fa2-1e8c7c55ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-58a352b5-b48a-4479-a7eb-302934e64815 req-d5367862-c8a2-4cc0-ac0a-8207e4262af0 tempest-AttachVolumeTestJSON-1734396399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-31868910-2c17-46c6-b39a-2c9ae8de9e37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a5cb52f-6dd9-4e7b-bddb-8c8b6f768775', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 13:55:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-581d49e1-94a3-40bc-93ca-f2b5647a7481 tempest-VolumesSnapshotTestJSON-179182244 None] Created volume successfully. Sep 11 13:55:36 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 Sep 11 13:55:36 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-58a352b5-b48a-4479-a7eb-302934e64815 req-d5367862-c8a2-4cc0-ac0a-8207e4262af0 tempest-AttachVolumeTestJSON-1734396399 None] attachment_update completed successfully. Sep 11 13:55:36 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6" returned: 0 in 0.395s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:36 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc 1G Sep 11 13:55:36 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3a556be9-f7d4-43a0-9089-f5bd0c37f33e tempest-GroupsV320Test-243136636 None] Group tempest-GroupsV320Test-Group-610653191: creating Sep 11 13:55:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3a556be9-f7d4-43a0-9089-f5bd0c37f33e tempest-GroupsV320Test-243136636 None] Group tempest-GroupsV320Test-Group-610653191: created successfully Sep 11 13:55:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3a556be9-f7d4-43a0-9089-f5bd0c37f33e tempest-GroupsV320Test-243136636 None] Create group completed successfully. Sep 11 13:55:36 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc 1G" returned: 0 in 0.505s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260b8671-c222-43db-82c2-6e1f1453c0e6 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:36 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260b8671-c222-43db-82c2-6e1f1453c0e6 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc Sep 11 13:55:36 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-f18a8308-a5a2-4541-a2df-9cb8d469460d-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-f18a8308-a5a2-4541-a2df-9cb8d469460d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-f18a8308-a5a2-4541-a2df-9cb8d469460d" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-f18a8308-a5a2-4541-a2df-9cb8d469460d" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55301a6-1280-4ae4-9e2f-c06ac0b7c069]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:37 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:37 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d Sep 11 13:55:37 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260b8671-c222-43db-82c2-6e1f1453c0e6 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:37 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc Sep 11 13:55:37 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:37 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:37 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:37 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d Sep 11 13:55:37 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:37 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info Sep 11 13:55:37 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:37 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f18a8308-a5a2-4541-a2df-9cb8d469460d" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-f18a8308-a5a2-4541-a2df-9cb8d469460d" released by "delete_volume" :: held 0.687s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['f25d8875-9637-43e2-9c1b-5737bdd2c37d', '58221313-c13e-4d1f-81ff-0c96bdd3b313', '4a0410cc-ff7f-49dd-a491-ad4d749d46f7', '4ef15002-f0b2-4a27-80be-3d19d3169a74'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:37 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:37 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info Sep 11 13:55:37 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:37 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:37 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:38 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.info" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:38 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.328s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Deleted volume successfully. Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-2a934481-f989-4a5a-afaa-6c03bf6f3ce4-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-52e8c594-0b41-42ab-91a4-4a482f752d90 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-f18a8308-a5a2-4541-a2df-9cb8d469460d-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-2a934481-f989-4a5a-afaa-6c03bf6f3ce4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-69bf83ef-6464-4e91-b696-c1b535f420b2" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-69bf83ef-6464-4e91-b696-c1b535f420b2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-2a934481-f989-4a5a-afaa-6c03bf6f3ce4" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f7dcec70-0d68-4507-9d1d-6419b3ca335b tempest-GroupSnapshotsV319Test-376253594 None] group_snapshot 9076641b-bdeb-4eee-bd7f-dd5a27dcc384: created successfully Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-2a934481-f989-4a5a-afaa-6c03bf6f3ce4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Deleting offline snapshot 2a934481-f989-4a5a-afaa-6c03bf6f3ce4 of volume 69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] snapshot_file for this snap is: volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133c6c6-ffb8-4ec8-a764-203264c30d47]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Created reservations ['ff77d4bc-6598-467d-b763-9eb82290aba3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:38 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:38 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:38 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 Sep 11 13:55:38 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-b6dde914-7546-45e7-b0df-1e446c4d7263 req-ac487b3e-9de0-4fae-8735-28d592c15397 tempest-AttachVolumeTestJSON-1734396399 None] Terminate volume connection completed successfully. Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-b6dde914-7546-45e7-b0df-1e446c4d7263 req-ac487b3e-9de0-4fae-8735-28d592c15397 tempest-AttachVolumeTestJSON-1734396399 None] Deleting attachment d3719065-bd29-465e-8c0a-6b37a7cf1699. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:55:38 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.266s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f4ab34fb-df86-4cdd-9c8f-3339185b941b tempest-GroupsV320Test-243136636 None] Delete group completed successfully. Sep 11 13:55:38 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4" returned: 0 in 0.389s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69bf83ef-6464-4e91-b696-c1b535f420b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa66b787-97d8-4bee-ac53-e6ac2f993916]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:38 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 Sep 11 13:55:38 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:39 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2" returned: 0 in 0.542s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:39 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 Sep 11 13:55:39 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] group_snapshot 9076641b-bdeb-4eee-bd7f-dd5a27dcc384: deleting Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] group_snapshot 9076641b-bdeb-4eee-bd7f-dd5a27dcc384: deleting {{(pid=88731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "cinder-quobyte-260b8671-c222-43db-82c2-6e1f1453c0e6" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Lock "cinder-quobyte-260b8671-c222-43db-82c2-6e1f1453c0e6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "cinder-quobyte-951e6d75-be09-4b98-9a4b-e4b6b30a95bc" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Lock "cinder-quobyte-951e6d75-be09-4b98-9a4b-e4b6b30a95bc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Deleting offline snapshot 951e6d75-be09-4b98-9a4b-e4b6b30a95bc of volume 260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] snapshot_file for this snap is: volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8d6b70-3e3e-4b05-b0fa-094bc0d40681]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:39 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc Sep 11 13:55:39 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:39 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4" returned: 0 in 0.527s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:39 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4 Sep 11 13:55:39 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:40 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-260b8671-c222-43db-82c2-6e1f1453c0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d23f3f-3fcc-4427-81df-486781488369]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-a45230eb-e195-45c8-8819-7f63cca978ac req-fd2c4f78-8ef8-4ae2-97da-44b0a0ac7c75 tempest-AttachVolumeTestJSON-1734396399 None] Terminate volume connection completed successfully. Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-a45230eb-e195-45c8-8819-7f63cca978ac req-fd2c4f78-8ef8-4ae2-97da-44b0a0ac7c75 tempest-AttachVolumeTestJSON-1734396399 None] Deleting attachment 8a5cb52f-6dd9-4e7b-bddb-8c8b6f768775. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 13:55:40 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2.2a934481-f989-4a5a-afaa-6c03bf6f3ce4" returned: 0 in 0.310s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:40 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 Sep 11 13:55:40 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-2a934481-f989-4a5a-afaa-6c03bf6f3ce4" released by "_delete_snapshot" :: held 1.884s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-69bf83ef-6464-4e91-b696-c1b535f420b2" released by "delete_snapshot" :: held 1.919s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['cc8316aa-d0d7-4498-b992-0eaee7aa9ab6', 'b949e400-a534-46fa-87c8-b2f16517904b', '072329d2-fc88-4240-88a4-0aa2c7cec27d', '6f92dc8f-8ca5-4d29-869b-aac2d7a9550b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Delete snapshot completed successfully. Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74a55b8-b2ad-4345-8487-ad1b2ab254d6 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-2a934481-f989-4a5a-afaa-6c03bf6f3ce4-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:40 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6" returned: 0 in 0.471s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:40 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc Sep 11 13:55:40 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:41 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc" returned: 0 in 0.383s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:41 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc Sep 11 13:55:41 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:41 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6.951e6d75-be09-4b98-9a4b-e4b6b30a95bc" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Lock "cinder-quobyte-951e6d75-be09-4b98-9a4b-e4b6b30a95bc" released by "_delete_snapshot" :: held 1.794s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Lock "cinder-quobyte-260b8671-c222-43db-82c2-6e1f1453c0e6" released by "delete_snapshot" :: held 1.827s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=169,cinder:SELECT=166,cinder:INSERT=37,cinder:DELETE=5 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:55:41 devstack cinder-volume[88731]: WARNING cinder.quota [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-604505528 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-604505528, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:55:41 devstack cinder-volume[88731]: WARNING cinder.quota [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-604505528 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-604505528, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] Created reservations ['b6d1e3c7-b219-4e4f-af96-5cb7558f883c', 'c96ca89c-dc5b-4785-bb62-4802ea2a2935', '7f2405c8-85a8-4428-b45b-a4085bee42f7', '532e61c2-cfe9-4dd0-8cad-6056b02ad336'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e606d8b7-a73e-4979-8d2b-cc40d4a7ae40 tempest-GroupSnapshotsV319Test-376253594 None] group_snapshot 9076641b-bdeb-4eee-bd7f-dd5a27dcc384: deleted successfully Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-69bf83ef-6464-4e91-b696-c1b535f420b2-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-69bf83ef-6464-4e91-b696-c1b535f420b2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-69bf83ef-6464-4e91-b696-c1b535f420b2" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-69bf83ef-6464-4e91-b696-c1b535f420b2" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b9b40d-f56d-473e-b53d-145d12069a67]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:42 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 Sep 11 13:55:42 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "cinder-quobyte-260b8671-c222-43db-82c2-6e1f1453c0e6" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Lock "cinder-quobyte-260b8671-c222-43db-82c2-6e1f1453c0e6" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa636bc-bf69-4d9a-8828-493f0ab21762]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:42 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2" returned: 0 in 0.623s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:42 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 Sep 11 13:55:42 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:42 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2 Sep 11 13:55:42 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:43 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6" returned: 0 in 0.543s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:43 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6 Sep 11 13:55:43 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:43 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-69bf83ef-6464-4e91-b696-c1b535f420b2" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-69bf83ef-6464-4e91-b696-c1b535f420b2" released by "delete_volume" :: held 1.210s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['99e3e267-5638-4bcc-95ce-2389feba7f43', 'd2d8b60a-727b-45c2-9b30-83c5181beef3', 'ef7f6edf-357c-4fce-b725-da20dbad8257', '59f5f911-8bca-43d9-8a9e-91aed6f2d6b9'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:43 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-260b8671-c222-43db-82c2-6e1f1453c0e6" returned: 0 in 0.319s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:43 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:43 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Lock "cinder-quobyte-260b8671-c222-43db-82c2-6e1f1453c0e6" released by "delete_volume" :: held 0.961s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Created reservations ['8b277d61-9688-4193-bcb9-8547c553cace'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:43 devstack cinder-volume[88731]: WARNING cinder.quota [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-604505528 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-604505528, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Created reservations ['5487167e-2cfd-4e8f-84a4-5760064a6ac6', 'c59165c3-0135-4616-9efd-5f39ffe6f8ba', 'fdf94a74-a8d1-4da1-88cd-51ca5734b4e1', '1ccb7688-aa46-4fa1-a363-88e3adc9c82e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:43 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:43 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:43 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.480s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Deleted volume successfully. Sep 11 13:55:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448df9a1-7b4d-40ac-ba1d-9fe55b70edca tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-69bf83ef-6464-4e91-b696-c1b535f420b2-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-9e185015-f6fd-4cd6-a915-4047cb064769-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-9e185015-f6fd-4cd6-a915-4047cb064769-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:44 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.369s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-06afc54a-bc49-4cec-99b2-401c0041077c tempest-GroupSnapshotsV319Test-376253594 None] Delete group completed successfully. Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "cinder-quobyte-9e185015-f6fd-4cd6-a915-4047cb064769" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-9e185015-f6fd-4cd6-a915-4047cb064769" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d744eb4-9b5f-4c17-aefe-dd4a0050e9ea]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:44 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 Sep 11 13:55:44 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:44 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769" returned: 0 in 0.427s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:44 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769 Sep 11 13:55:44 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:44 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e185015-f6fd-4cd6-a915-4047cb064769" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-quobyte-9e185015-f6fd-4cd6-a915-4047cb064769" released by "delete_volume" :: held 0.784s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Created reservations ['a7445977-ccac-41f1-b168-8f2847a202da', '67256a65-18ce-4ee2-9897-6e20578f2bf0', '0e608a2f-a1a7-4009-9bc2-0386386c637a', '5b178322-e744-4709-97a7-1be2efdaf580'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:45 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:45 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:45 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.317s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:45 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Deleted volume successfully. Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f9718bc5-1d52-46e3-81f0-165a3bbf4b54 tempest-VolumesSnapshotTestJSON-179182244 None] Lock "cinder-9e185015-f6fd-4cd6-a915-4047cb064769-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "cinder-31868910-2c17-46c6-b39a-2c9ae8de9e37-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-31868910-2c17-46c6-b39a-2c9ae8de9e37-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "cinder-quobyte-31868910-2c17-46c6-b39a-2c9ae8de9e37" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-quobyte-31868910-2c17-46c6-b39a-2c9ae8de9e37" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf2ef9-52bb-4b62-8fe7-9652cfa6bd84]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:46 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 Sep 11 13:55:46 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:46 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37" returned: 0 in 0.464s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:46 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37 Sep 11 13:55:46 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:46 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31868910-2c17-46c6-b39a-2c9ae8de9e37" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-quobyte-31868910-2c17-46c6-b39a-2c9ae8de9e37" released by "delete_volume" :: held 0.831s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Created reservations ['98875dde-1a9e-4ccb-b34c-a7e5064c967f', '90ee80dc-a150-4937-ad62-ddb09962119c', '59eb4614-6cd3-4282-8084-64b674e65684', '9b2f6407-43ec-4f09-8c2d-db35276b21da'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:46 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:46 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "cinder-bc78464f-294f-49f8-9e8c-53a6139c45b0-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-bc78464f-294f-49f8-9e8c-53a6139c45b0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "cinder-quobyte-bc78464f-294f-49f8-9e8c-53a6139c45b0" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-quobyte-bc78464f-294f-49f8-9e8c-53a6139c45b0" acquired by "delete_volume" :: waited 0.038s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6dacd-3b20-4dfb-b550-77cb35c18b8d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:47 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.366s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:47 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Deleted volume successfully. Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b2b47430-98eb-430f-bd4c-066e208b1bae tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-31868910-2c17-46c6-b39a-2c9ae8de9e37-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:47 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 Sep 11 13:55:47 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:47 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0" returned: 0 in 0.492s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:47 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0 Sep 11 13:55:47 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:48 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc78464f-294f-49f8-9e8c-53a6139c45b0" returned: 0 in 0.308s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-quobyte-bc78464f-294f-49f8-9e8c-53a6139c45b0" released by "delete_volume" :: held 0.852s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Created reservations ['4366a388-5760-421b-9633-8f971be832c0', '6ad4fd1b-acf1-4c0f-9852-0a624eb236d2', '44d2e292-3369-4642-97c3-87a55fb8e41b', '5b8ff58e-1529-4891-b0ae-7dd6a3505685'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:48 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:48 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "cinder-64504831-bb9b-45ad-a158-6d9ab9713858-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-64504831-bb9b-45ad-a158-6d9ab9713858-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "cinder-quobyte-64504831-bb9b-45ad-a158-6d9ab9713858" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-quobyte-64504831-bb9b-45ad-a158-6d9ab9713858" acquired by "delete_volume" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:55:48 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.410s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03522b85-65ac-4b03-857a-a5bd011febf2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Deleted volume successfully. Sep 11 13:55:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-11d78465-e5c9-42ee-977d-6e13353d93e5 tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-bc78464f-294f-49f8-9e8c-53a6139c45b0-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:48 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 Sep 11 13:55:48 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:49 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:49 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858 Sep 11 13:55:49 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:49 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-64504831-bb9b-45ad-a158-6d9ab9713858" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-quobyte-64504831-bb9b-45ad-a158-6d9ab9713858" released by "delete_volume" :: held 0.892s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Created reservations ['f44deb8b-2da0-4ff2-ad78-4a3300595a70', '4c5fe343-7131-4fe1-a4e0-acb492fb041a', '90565d88-8825-46d3-b5b0-feae0d0b9b9b', '7ce157fa-981c-4501-92c9-ded63228fc91'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:49 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:55:49 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:50 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:50 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:55:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Deleted volume successfully. Sep 11 13:55:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a3c5a5dc-69da-43fe-84fe-5e12439d617c tempest-AttachVolumeTestJSON-1734396399 None] Lock "cinder-64504831-bb9b-45ad-a158-6d9ab9713858-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Flow 'volume_create_manager' (c0f62ca0-f54c-4f6b-94e5-5323d288ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e846fb9-8892-412a-9a8d-b2f98cedc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e846fb9-8892-412a-9a8d-b2f98cedc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2126059737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221c301f-ed56-49ec-b383-abb06475e30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac803da98b2459bb0d4178ce7ddb846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:56Z,use_quota=True,user_id='798d99933186448eb66d8f43765529a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9153da70-3966-449b-b125-f78126aa9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9153da70-3966-449b-b125-f78126aa9723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e42d0f8-cc66-46f1-a2e2-0ffb4f133321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e42d0f8-cc66-46f1-a2e2-0ffb4f133321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221c301f-ed56-49ec-b383-abb06475e30c', 'volume_name': 'volume-221c301f-ed56-49ec-b383-abb06475e30c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b9ad10-f153-488f-8f98-a2978a7925cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b9ad10-f153-488f-8f98-a2978a7925cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15837625-7c34-4861-b331-7c4215535294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Volume 221c301f-ed56-49ec-b383-abb06475e30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221c301f-ed56-49ec-b383-abb06475e30c', 'volume_size': 1} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2126059737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221c301f-ed56-49ec-b383-abb06475e30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac803da98b2459bb0d4178ce7ddb846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:56Z,use_quota=True,user_id='798d99933186448eb66d8f43765529a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Creating volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:55:56 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:56 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c 1073741824 Sep 11 13:55:56 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:56 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c 1073741824" returned: 0 in 0.655s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:57 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c Sep 11 13:55:57 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:57 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c" returned: 0 in 0.322s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15837625-7c34-4861-b331-7c4215535294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221c301f-ed56-49ec-b383-abb06475e30c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10bd6c8-d1f5-455d-b937-ed4cd3e357dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:57 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Volume volume-221c301f-ed56-49ec-b383-abb06475e30c (221c301f-ed56-49ec-b383-abb06475e30c): created successfully Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10bd6c8-d1f5-455d-b937-ed4cd3e357dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Flow 'volume_create_manager' (c0f62ca0-f54c-4f6b-94e5-5323d288ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b54a9366-1056-43b0-9084-c2a84a530c68 tempest-VolumesSnapshotListTestJSON-552039416 None] Created volume successfully. Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Creating offline snapshot ca1ef86f-e430-49c6-930c-d7d8e39e28d1 of volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d94174-a02f-4af1-8054-b2a4355a62ff]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:58 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c Sep 11 13:55:58 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Flow 'volume_create_manager' (04b69b56-ccfa-4de9-bf7e-219094e266b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eca9e9-c249-4f5d-8de1-336452c8a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eca9e9-c249-4f5d-8de1-336452c8a930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1787887382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b354237-5693-4f65-afc2-ec7551a491b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bdac270c724c3f8e48efa596f6e66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:59Z,use_quota=True,user_id='c45f928abb3e48288cb8199aea035fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998fac4f-e826-4ea5-b91f-639916caee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998fac4f-e826-4ea5-b91f-639916caee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cae4bd-2fc3-498d-8648-a84d63d9d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cae4bd-2fc3-498d-8648-a84d63d9d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b354237-5693-4f65-afc2-ec7551a491b1', 'volume_name': 'volume-3b354237-5693-4f65-afc2-ec7551a491b1', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6239da45-cd45-48e9-be9c-209cb2ef0eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6239da45-cd45-48e9-be9c-209cb2ef0eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03fa05d-ac7c-40a7-8f28-ca7c298a37f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:58 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Volume 3b354237-5693-4f65-afc2-ec7551a491b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b354237-5693-4f65-afc2-ec7551a491b1', 'volume_size': 1} Sep 11 13:55:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:59 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c" returned: 0 in 0.467s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:59 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 1G Sep 11 13:55:59 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:59 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 1G" returned: 0 in 0.475s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:59 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:55:59 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Flow 'volume_create_manager' (20ca9496-4248-4cd5-87e6-526867391f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b4717-2c6f-413f-8628-8259c155132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b4717-2c6f-413f-8628-8259c155132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1523937543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1e1d80b4534384be323538b030ac47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:00Z,use_quota=True,user_id='d2ff3ac01238488f9de750e95fccbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a9a698-ec73-4a37-ad26-4933ab63ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a9a698-ec73-4a37-ad26-4933ab63ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf307c5-1ab9-45a4-aee4-8c331db264eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf307c5-1ab9-45a4-aee4-8c331db264eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8', 'volume_name': 'volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db5f260-f4d5-487c-b7fb-f1aa873f00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db5f260-f4d5-487c-b7fb-f1aa873f00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdbe529-60a8-44f7-9056-ff7dd7128d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:55:59 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Volume fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8', 'volume_size': 1} Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:55:59 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.381s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:55:59 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 is being set with open permissions: ugo+rw Sep 11 13:55:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:55:59 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:55:59 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:00 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=167,cinder:SELECT=169,cinder:DELETE=14,cinder:INSERT=41 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:00 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info Sep 11 13:56:00 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:00 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info" returned: 0 in 0.252s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:00 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info is being set with open permissions: ugo+rw Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:00 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info Sep 11 13:56:00 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:00 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.info" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1787887382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b354237-5693-4f65-afc2-ec7551a491b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bdac270c724c3f8e48efa596f6e66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:55:59Z,use_quota=True,user_id='c45f928abb3e48288cb8199aea035fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Creating volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:56:00 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:56:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:00 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 1073741824 Sep 11 13:56:00 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-99e28f05-4e65-463e-82ee-1ad56eabf12d tempest-VolumesSnapshotListTestJSON-552039416 None] Create snapshot completed successfully Sep 11 13:56:01 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 1073741824" returned: 0 in 0.449s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:01 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 Sep 11 13:56:01 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Flow 'volume_create_manager' (b8c66675-148c-4b1b-9e93-8c33a800b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b650e5-3e45-45d5-86e7-f495974a3257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b650e5-3e45-45d5-86e7-f495974a3257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-76058156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ab8c51-389e-4cdd-8172-0d5824f33346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e058922f9f46d8ae07f7e1542aeea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:01Z,use_quota=True,user_id='5ffbed1e3be44b6cb2dd27a3abe63bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d9b946-aaa6-4dd2-b7bf-8cd31df568e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d9b946-aaa6-4dd2-b7bf-8cd31df568e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25952d1e-b611-4b28-9c55-7dbb6d3052d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25952d1e-b611-4b28-9c55-7dbb6d3052d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ab8c51-389e-4cdd-8172-0d5824f33346', 'volume_name': 'volume-65ab8c51-389e-4cdd-8172-0d5824f33346', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde113eb-92c9-49bd-a4d4-30e50eeac342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde113eb-92c9-49bd-a4d4-30e50eeac342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e67dfdb-0abd-4ccf-a2f8-d17fade46434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:01 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Volume 65ab8c51-389e-4cdd-8172-0d5824f33346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ab8c51-389e-4cdd-8172-0d5824f33346', 'volume_size': 1} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:01 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1523937543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1e1d80b4534384be323538b030ac47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:00Z,use_quota=True,user_id='d2ff3ac01238488f9de750e95fccbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Creating volume fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:56:01 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:01 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 1073741824 Sep 11 13:56:01 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03fa05d-ac7c-40a7-8f28-ca7c298a37f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b354237-5693-4f65-afc2-ec7551a491b1', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506f6344-13a1-479f-8ac8-d1833976cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:01 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Volume volume-3b354237-5693-4f65-afc2-ec7551a491b1 (3b354237-5693-4f65-afc2-ec7551a491b1): created successfully Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506f6344-13a1-479f-8ac8-d1833976cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Flow 'volume_create_manager' (04b69b56-ccfa-4de9-bf7e-219094e266b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ac05ac61-5086-46f6-8954-659df0924ec7 tempest-SnapshotsActionsTest-749365157 None] Created volume successfully. Sep 11 13:56:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:02 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 1073741824" returned: 0 in 0.489s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:02 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 Sep 11 13:56:02 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:02 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-76058156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ab8c51-389e-4cdd-8172-0d5824f33346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e058922f9f46d8ae07f7e1542aeea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:01Z,use_quota=True,user_id='5ffbed1e3be44b6cb2dd27a3abe63bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Creating volume 65ab8c51-389e-4cdd-8172-0d5824f33346 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:56:02 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdbe529-60a8-44f7-9056-ff7dd7128d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44190074-0f34-4d91-a6cf-7383e2e19acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:02 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 1073741824 Sep 11 13:56:02 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:02 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Volume volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 (fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8): created successfully Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44190074-0f34-4d91-a6cf-7383e2e19acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Flow 'volume_create_manager' (20ca9496-4248-4cd5-87e6-526867391f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-c97f8456-c7d9-4ffa-9f6c-cc1e8f0fe4f7 req-792a8de0-16e8-47f2-ab59-516104958f09 tempest-VolumesGetTestJSON-362222428 None] Created volume successfully. Sep 11 13:56:02 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 1073741824" returned: 0 in 0.402s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:02 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 Sep 11 13:56:02 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:02 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.144s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e67dfdb-0abd-4ccf-a2f8-d17fade46434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ab8c51-389e-4cdd-8172-0d5824f33346', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf8de22-2598-45e0-bf8e-b2db1e305f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Creating offline snapshot e431b9fe-68a2-43d6-be58-eeb8dd34e41f of volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Volume volume-65ab8c51-389e-4cdd-8172-0d5824f33346 (65ab8c51-389e-4cdd-8172-0d5824f33346): created successfully Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf8de22-2598-45e0-bf8e-b2db1e305f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Flow 'volume_create_manager' (b8c66675-148c-4b1b-9e93-8c33a800b211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca4eb0b-9fcb-4f81-96bc-6250ce9b9222]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:03 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-783d7701-53f7-423d-ba72-c9f60086fd76 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Created volume successfully. Sep 11 13:56:03 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:56:03 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Acquiring lock "cinder-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Lock "cinder-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:03 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.391s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:03 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f 1G Sep 11 13:56:03 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Acquiring lock "cinder-quobyte-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Lock "cinder-quobyte-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc0d619-b5cd-48c7-843f-641e2d658c5a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:03 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 Sep 11 13:56:03 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:03 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8" returned: 0 in 0.388s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:03 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8 Sep 11 13:56:03 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:03 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f 1G" returned: 0 in 0.526s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:04 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:04 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:04 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Lock "cinder-quobyte-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8" released by "delete_volume" :: held 0.698s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.quota [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Created reservations ['5ef63a92-edcc-401a-9ed7-080414b9c969', '58ff42f4-f3d9-4da1-8f0c-73a15b6ebf6f', '6da84de8-25a1-4e2f-a92a-7c0b512d9f2f', 'a1c9feee-55b0-4b77-bdcd-5e8e64b3d77f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:04 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:04 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f is being set with open permissions: ugo+rw Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:04 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:04 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:04 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:04 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Acquiring lock "cinder-65ab8c51-389e-4cdd-8172-0d5824f33346-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "cinder-65ab8c51-389e-4cdd-8172-0d5824f33346-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Acquiring lock "cinder-quobyte-65ab8c51-389e-4cdd-8172-0d5824f33346" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "cinder-quobyte-65ab8c51-389e-4cdd-8172-0d5824f33346" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:04 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.288s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caa307e-0a55-44ac-be80-57ac62b090c8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:04 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.684s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.447s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.322s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.manager [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Deleted volume successfully. Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Creating offline snapshot ea36ba7d-abae-4bb4-a03e-ebd2480623f4 of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9b492805-4734-4381-8057-3ba6d70108cb tempest-VolumesSnapshotListTestJSON-552039416 None] Create snapshot completed successfully Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80958293-33bb-439d-996e-24f4e9e6ef23]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-bc2e7c3a-2a3c-4eb2-975c-6277c0dedfd9 req-435cea8d-5cc4-4d4f-8376-b5f7be3ad2c1 tempest-VolumesGetTestJSON-362222428 None] Lock "cinder-fadcb505-1bce-4fe8-9c9e-55d0e62ad0d8-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:04 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 Sep 11 13:56:04 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:04 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 Sep 11 13:56:04 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:05 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346" returned: 0 in 0.411s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:05 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346 Sep 11 13:56:05 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:05 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1" returned: 0 in 0.445s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:05 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 1G Sep 11 13:56:05 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:05 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65ab8c51-389e-4cdd-8172-0d5824f33346" returned: 0 in 0.319s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "cinder-quobyte-65ab8c51-389e-4cdd-8172-0d5824f33346" released by "delete_volume" :: held 0.795s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Created reservations ['67d9d15a-a80a-406a-87fd-592ceee7a226', 'd542b68f-9e88-47d8-9976-502aa5d69dce', '15aefae7-1f86-4d7d-bb56-28d9dbf5124b', '883758bc-eed1-4ade-bf3e-7f902f384535'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:05 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:05 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:05 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 1G" returned: 0 in 0.486s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:05 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:05 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:05 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.331s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Deleted volume successfully. Sep 11 13:56:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f4511c91-9ec9-4d62-8260-3f26041e56b0 tempest-VolumeQuotasNegativeTestJSON-1326223366 None] Lock "cinder-65ab8c51-389e-4cdd-8172-0d5824f33346-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:06 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:06 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 is being set with open permissions: ugo+rw Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:06 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:06 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:06 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:06 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info Sep 11 13:56:06 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:06 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:06 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info is being set with open permissions: ugo+rw Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:06 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info Sep 11 13:56:06 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:06 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.info" returned: 0 in 0.261s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.696s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Creating offline snapshot f46e6da8-6207-4950-9807-a1caa4e248a8 of volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf5e29-d30e-4845-ba75-f47e9b72cd10]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-413c4fb3-9bef-4831-8b62-6f755c5836ae tempest-SnapshotsActionsTest-749365157 None] Create snapshot completed successfully Sep 11 13:56:07 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:07 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:07 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.399s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:07 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 1G Sep 11 13:56:07 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:08 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 1G" returned: 0 in 0.658s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:08 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 Sep 11 13:56:08 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:08 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:08 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 is being set with open permissions: ugo+rw Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:08 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 Sep 11 13:56:08 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:08 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8" returned: 0 in 0.309s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Creating offline snapshot f04e1868-4b8f-460b-a899-66583804322d of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-88b01ea7-895c-4ee8-9fb8-1491830bbf90 tempest-VolumesSnapshotListTestJSON-552039416 None] Create snapshot completed successfully Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[171facc4-4e73-4dca-8225-264db3f747aa]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:08 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:08 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:09 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.422s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:09 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d 1G Sep 11 13:56:09 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:09 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d 1G" returned: 0 in 0.539s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:09 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d Sep 11 13:56:09 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:10 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d" returned: 0 in 0.380s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:10 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d is being set with open permissions: ugo+rw Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:10 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d Sep 11 13:56:10 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:10 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d" returned: 0 in 0.315s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:10 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:10 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-81c91970-d2ec-45f8-8b1e-972cc7a41813 tempest-SnapshotsActionsTest-749365157 None] Create snapshot completed successfully Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-f46e6da8-6207-4950-9807-a1caa4e248a8-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-f46e6da8-6207-4950-9807-a1caa4e248a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-f46e6da8-6207-4950-9807-a1caa4e248a8" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-f46e6da8-6207-4950-9807-a1caa4e248a8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Deleting offline snapshot f46e6da8-6207-4950-9807-a1caa4e248a8 of volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] snapshot_file for this snap is: volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76193f82-d324-41e9-bfe6-8b038aaeaca2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:10 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.386s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:56:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:56:10 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 Sep 11 13:56:10 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:11 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d4214e-8723-4151-9fc7-0460a0251806]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:11 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:11 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-f04e1868-4b8f-460b-a899-66583804322d-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-f04e1868-4b8f-460b-a899-66583804322d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-f04e1868-4b8f-460b-a899-66583804322d" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-f04e1868-4b8f-460b-a899-66583804322d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Deleting offline snapshot f04e1868-4b8f-460b-a899-66583804322d of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:11 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] snapshot_file for this snap is: volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.479s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e40846a-2567-4441-9cc2-744cea67323b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:11 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 Sep 11 13:56:11 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:11 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d Sep 11 13:56:11 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:12 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d" returned: 0 in 0.460s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c50bba-4a2c-4484-97e7-a834b3e0e566]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:12 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8" returned: 0 in 0.555s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:12 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8 Sep 11 13:56:12 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:12 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:12 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:12 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.f46e6da8-6207-4950-9807-a1caa4e248a8" returned: 0 in 0.348s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-f46e6da8-6207-4950-9807-a1caa4e248a8" released by "_delete_snapshot" :: held 1.931s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" released by "delete_snapshot" :: held 1.960s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:12 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.488s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:12 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d Sep 11 13:56:12 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Created reservations ['cc65fe39-7d94-42fe-90e4-6f4816bb07c4', 'de3fead2-d735-4c93-b54b-0c3572b31fc2', '644a9adf-c667-4a0d-9c48-ca444bc72727', 'e2dc9277-6785-4036-9c78-a8d9001dfdde'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Delete snapshot completed successfully. Sep 11 13:56:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1d05fda3-cec0-4b54-a584-269b9b3c818f tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-f46e6da8-6207-4950-9807-a1caa4e248a8-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:13 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d" returned: 0 in 0.480s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:13 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d Sep 11 13:56:13 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:56:13 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Flow 'volume_create_manager' (dc08f01c-6132-44c0-8a5e-cecf650a8d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14dd1f4-dec7-4ccb-aa8d-70d923db57ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.f04e1868-4b8f-460b-a899-66583804322d" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14dd1f4-dec7-4ccb-aa8d-70d923db57ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1372428508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b407ab-ec1e-405e-9d82-bd7a5b55ae3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e851fd0b38345c09fe377abdf76e219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:13Z,use_quota=True,user_id='1ac98b1bf17041328abdcbcaed0faeb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc87f7d-f2f3-470e-9475-3ea0f84a1267),volume_type_id=0bc87f7d-f2f3-470e-9475-3ea0f84a1267)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367b5fdc-9303-45fc-ad7b-8a6896c2a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367b5fdc-9303-45fc-ad7b-8a6896c2a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd1b85e-14e2-4d7e-9ae5-1e833c6f30d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd1b85e-14e2-4d7e-9ae5-1e833c6f30d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b407ab-ec1e-405e-9d82-bd7a5b55ae3f', 'volume_name': 'volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc75733-2a59-4f33-9e17-eb807bea3e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc75733-2a59-4f33-9e17-eb807bea3e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af555ed-4144-49dc-af4c-9ecbb53f9b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:13 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Volume 93b407ab-ec1e-405e-9d82-bd7a5b55ae3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f', 'volume_size': 1} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1372428508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b407ab-ec1e-405e-9d82-bd7a5b55ae3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e851fd0b38345c09fe377abdf76e219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:13Z,use_quota=True,user_id='1ac98b1bf17041328abdcbcaed0faeb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc87f7d-f2f3-470e-9475-3ea0f84a1267),volume_type_id=0bc87f7d-f2f3-470e-9475-3ea0f84a1267)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Creating volume 93b407ab-ec1e-405e-9d82-bd7a5b55ae3f {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:56:13 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-f04e1868-4b8f-460b-a899-66583804322d" released by "_delete_snapshot" :: held 1.916s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" released by "delete_snapshot" :: held 1.951s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:13 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f 1073741824 Sep 11 13:56:13 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Created reservations ['1f74acd6-536c-4899-8bf1-283b8e2a501f', '90e12524-604e-4a93-86e7-3d2373ff6b4f', 'b1a4a0d6-b5ab-45dc-844e-f68c5c4b66c4', 'e5c400a3-5478-4cf3-a4dd-87283817e79a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Delete snapshot completed successfully. Sep 11 13:56:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e640b71f-fa1b-4f7d-b95c-8223afa8564b tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-f04e1868-4b8f-460b-a899-66583804322d-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-e431b9fe-68a2-43d6-be58-eeb8dd34e41f-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-e431b9fe-68a2-43d6-be58-eeb8dd34e41f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" acquired by "delete_snapshot" :: waited 0.070s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-e431b9fe-68a2-43d6-be58-eeb8dd34e41f" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-e431b9fe-68a2-43d6-be58-eeb8dd34e41f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Deleting offline snapshot e431b9fe-68a2-43d6-be58-eeb8dd34e41f of volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] snapshot_file for this snap is: volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f72e65-6421-46ef-ad39-a9bb34bbdc3a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:14 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f 1073741824" returned: 0 in 0.546s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:14 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f Sep 11 13:56:14 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:14 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:14 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:14 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f" returned: 0 in 0.285s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.215s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af555ed-4144-49dc-af4c-9ecbb53f9b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c8563e-b73b-41c7-9d00-8a28f442073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Creating offline snapshot 5f902998-dce5-4b8a-82d8-3fa64f5061dd of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:14 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.453s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0047b7-219d-4439-9df5-8651947dd3ec]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf3810-3230-42e0-8f71-0e35172dc369]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Volume volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f (93b407ab-ec1e-405e-9d82-bd7a5b55ae3f): created successfully Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c8563e-b73b-41c7-9d00-8a28f442073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Flow 'volume_create_manager' (dc08f01c-6132-44c0-8a5e-cecf650a8d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-70b15534-92c9-4c4e-a823-84f65112f068 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Created volume successfully. Sep 11 13:56:14 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:56:14 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:14 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:14 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:15 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.430s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:15 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.454s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:15 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:15 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:15 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd 1G Sep 11 13:56:15 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:15 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.437s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:15 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f Sep 11 13:56:15 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:15 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd 1G" returned: 0 in 0.555s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:15 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd Sep 11 13:56:15 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:15 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.e431b9fe-68a2-43d6-be58-eeb8dd34e41f" returned: 0 in 0.309s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-e431b9fe-68a2-43d6-be58-eeb8dd34e41f" released by "_delete_snapshot" :: held 1.792s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" released by "delete_snapshot" :: held 1.826s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Created reservations ['89c84d02-0628-47af-aa07-cf362e7ac1c2', 'bc11a713-e54a-4a08-843b-aa6661ac5526', '0d3aff37-8ed8-4f5a-8d31-5bf4cd8465a9', 'f6dd586b-6f58-466a-8eb2-3e45651a5d93'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:16 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:16 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd is being set with open permissions: ugo+rw Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:16 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd Sep 11 13:56:16 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Delete snapshot completed successfully. Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-03ece02b-7cc7-47f2-b822-442289b750cc tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-e431b9fe-68a2-43d6-be58-eeb8dd34e41f-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:16 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:16 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-ca1ef86f-e430-49c6-930c-d7d8e39e28d1-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-ca1ef86f-e430-49c6-930c-d7d8e39e28d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-ca1ef86f-e430-49c6-930c-d7d8e39e28d1" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-ca1ef86f-e430-49c6-930c-d7d8e39e28d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Deleting offline snapshot ca1ef86f-e430-49c6-930c-d7d8e39e28d1 of volume 221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] snapshot_file for this snap is: volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d3f4df-1f60-433b-9d36-6514a3578f57]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:16 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:16 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.309s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9297f63c-0321-4e11-9750-5f6eccdd80a6 tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Retype volume completed successfully. Sep 11 13:56:16 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:56:16 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1acf22b2-f5c6-465c-8350-2d38bf4db433 tempest-SnapshotsActionsTest-749365157 None] Create snapshot completed successfully Sep 11 13:56:16 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.395s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221c301f-ed56-49ec-b383-abb06475e30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88dd2c2-319f-4823-8688-8f25948dcc7b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:16 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c Sep 11 13:56:16 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:17 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c" returned: 0 in 0.377s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:17 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:56:17 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Acquiring lock "cinder-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "cinder-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Acquiring lock "cinder-quobyte-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "cinder-quobyte-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d8eca0-3213-477c-9c01-1013dcb5d556]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:17 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f Sep 11 13:56:17 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:17 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.467s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:17 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1 Sep 11 13:56:17 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-5f902998-dce5-4b8a-82d8-3fa64f5061dd-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-5f902998-dce5-4b8a-82d8-3fa64f5061dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-5f902998-dce5-4b8a-82d8-3fa64f5061dd" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-5f902998-dce5-4b8a-82d8-3fa64f5061dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Deleting offline snapshot 5f902998-dce5-4b8a-82d8-3fa64f5061dd of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] snapshot_file for this snap is: volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ddc4f-66c7-4d57-bb14-29d4388bcc27]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:17 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f" returned: 0 in 0.435s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:17 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd Sep 11 13:56:17 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:17 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:17 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f Sep 11 13:56:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c.ca1ef86f-e430-49c6-930c-d7d8e39e28d1" returned: 0 in 0.325s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:17 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-ca1ef86f-e430-49c6-930c-d7d8e39e28d1" released by "_delete_snapshot" :: held 1.705s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" released by "delete_snapshot" :: held 1.738s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Created reservations ['e38fe6f7-5cf6-41ad-aff0-cc565475323f', 'd8d9764d-1ac9-4222-8582-8444b54b17d6', '29f33d43-5a08-427a-9212-0a29cb459216', 'dbb1c26f-dfb9-4438-b04b-2b3b73920268'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Delete snapshot completed successfully. Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f02dbd9-05e8-4018-8196-f9cbd4dc0d78 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-ca1ef86f-e430-49c6-930c-d7d8e39e28d1-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:18 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "cinder-quobyte-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f" released by "delete_volume" :: held 0.770s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:18 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd" returned: 0 in 0.440s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc828b1-6a44-454c-afda-49c7ce0dab8e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:18 devstack cinder-volume[88731]: WARNING cinder.quota [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:56:18 devstack cinder-volume[88731]: WARNING cinder.quota [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Created reservations ['7c047983-d1cf-4777-a9eb-ba5ebd69d765', 'aebde09f-3786-48a4-8275-8a6080633db6', 'd6e2df11-96db-4246-93ce-c884f595630b', 'ce5a0e06-c4cb-4f1b-ae3e-2121c5053520'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:18 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:18 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:18 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:18 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-221c301f-ed56-49ec-b383-abb06475e30c-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-221c301f-ed56-49ec-b383-abb06475e30c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e821b74e-1341-4012-b2af-bbc4be037987]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:18 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:18 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.655s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.554s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Deleted volume successfully. Sep 11 13:56:18 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd Sep 11 13:56:18 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:18 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c Sep 11 13:56:18 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed3bed7c-2413-43ca-add7-a3d12c56deba tempest-VolumeRetypeWithoutMigrationTest-2119032405 None] Lock "cinder-93b407ab-ec1e-405e-9d82-bd7a5b55ae3f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:19 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c" returned: 0 in 0.457s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:19 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c Sep 11 13:56:19 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:19 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd" returned: 0 in 0.534s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:19 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd Sep 11 13:56:19 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:19 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-221c301f-ed56-49ec-b383-abb06475e30c" returned: 0 in 0.367s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-quobyte-221c301f-ed56-49ec-b383-abb06475e30c" released by "delete_volume" :: held 0.981s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:19 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.5f902998-dce5-4b8a-82d8-3fa64f5061dd" returned: 0 in 0.388s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-5f902998-dce5-4b8a-82d8-3fa64f5061dd" released by "_delete_snapshot" :: held 2.144s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Created reservations ['ceb9a866-5da8-47f4-8ef9-9686bd4a25b8', '6c2d37fb-fca6-4f2a-add1-53d0ad36bd82', 'a35ecf40-14c5-4f2f-b4a2-e6cb1bafa3cd', '3f6d2c94-cd30-4a39-a157-770352c3557c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" released by "delete_snapshot" :: held 2.185s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:20 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:20 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Created reservations ['e99c9b67-a6e3-4b04-898a-2e2bb1053c11', '0a227868-80b9-4f02-a91c-20d86ffa511d', '8a215e42-7fa2-4e29-b689-5198f23685c9', '284a07a0-1b3e-4b65-b554-51997205c960'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Delete snapshot completed successfully. Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57694141-01ad-4fda-bc90-5c4109a4332a tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-5f902998-dce5-4b8a-82d8-3fa64f5061dd-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:20 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.290s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Deleted volume successfully. Sep 11 13:56:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1f1fbf7-aec1-4a83-9c15-85a73652cb55 tempest-VolumesSnapshotListTestJSON-552039416 None] Lock "cinder-221c301f-ed56-49ec-b383-abb06475e30c-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Creating offline snapshot 792bee78-3f39-4646-bc4f-2e56f66b7a7d of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463bc0f-bf6a-4bd6-9e92-673781ca0b45]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:21 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:21 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:21 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.423s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:21 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d 1G Sep 11 13:56:21 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:22 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d 1G" returned: 0 in 0.552s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:22 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d Sep 11 13:56:22 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:22 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:22 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d is being set with open permissions: ugo+rw Sep 11 13:56:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:22 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d Sep 11 13:56:22 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:23 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.734s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-aa23e9f6-cd8f-49e4-8bb8-55c460e77333 tempest-SnapshotsActionsTest-749365157 None] Create snapshot completed successfully Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-792bee78-3f39-4646-bc4f-2e56f66b7a7d-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-792bee78-3f39-4646-bc4f-2e56f66b7a7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-792bee78-3f39-4646-bc4f-2e56f66b7a7d" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-792bee78-3f39-4646-bc4f-2e56f66b7a7d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Deleting offline snapshot 792bee78-3f39-4646-bc4f-2e56f66b7a7d of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] snapshot_file for this snap is: volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd40ee81-376d-4b85-9cb8-a6cfca7a7b3f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:23 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d Sep 11 13:56:23 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:24 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d" returned: 0 in 0.540s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66de41-4c69-43eb-b222-fccefc9bc9f1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:24 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:24 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:24 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.441s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:24 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d Sep 11 13:56:24 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:25 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d" returned: 0 in 0.525s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:25 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d Sep 11 13:56:25 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:25 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.792bee78-3f39-4646-bc4f-2e56f66b7a7d" returned: 0 in 0.340s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-792bee78-3f39-4646-bc4f-2e56f66b7a7d" released by "_delete_snapshot" :: held 1.987s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" released by "delete_snapshot" :: held 2.022s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Created reservations ['35d75061-cc73-49d9-8af5-ee20f88d15dc', '4c08ab5a-897c-4da9-b6f0-bbe850188e18', 'be221a34-61e1-4485-806a-775e30632f84', 'eaa2cddb-65dd-433e-8ce1-da91d3954eaf'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Delete snapshot completed successfully. Sep 11 13:56:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-17aedc35-69e0-4e33-a566-654bc92f10de tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-792bee78-3f39-4646-bc4f-2e56f66b7a7d-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Creating offline snapshot cbc4f940-e36f-4a45-b1fe-0a232c424552 of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7217d50b-0896-4976-846b-6660926c18df]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:27 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:27 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:27 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.632s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:28 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 1G Sep 11 13:56:28 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:28 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 1G" returned: 0 in 0.597s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:28 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 Sep 11 13:56:28 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:29 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552" returned: 0 in 0.452s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:29 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 is being set with open permissions: ugo+rw Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:29 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 Sep 11 13:56:29 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Flow 'volume_create_manager' (8c8e445f-5e81-4f03-9b86-111d50e5541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5443a08-5af6-43f9-848b-8f62a7e8d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5443a08-5af6-43f9-848b-8f62a7e8d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-770815735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d028dc9-2ec3-44d8-99e1-3375ca261e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ad6c17ba4441592d6aa8ab9122cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:29Z,use_quota=True,user_id='6764a80cdda440bb99b3657d5cd55d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ec3647-2e4f-4c9a-ac53-a36637bd1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ec3647-2e4f-4c9a-ac53-a36637bd1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff3b7cd-607f-42a8-87c4-48a9d69e51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff3b7cd-607f-42a8-87c4-48a9d69e51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d028dc9-2ec3-44d8-99e1-3375ca261e44', 'volume_name': 'volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd9a48d-d976-4c72-a105-4520e13c737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd9a48d-d976-4c72-a105-4520e13c737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4946c74b-6a4d-4bbe-9c9f-8bd4bf6698ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Volume 3d028dc9-2ec3-44d8-99e1-3375ca261e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44', 'volume_size': 1} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:29 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552" returned: 0 in 0.341s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.214s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-770815735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d028dc9-2ec3-44d8-99e1-3375ca261e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ad6c17ba4441592d6aa8ab9122cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:29Z,use_quota=True,user_id='6764a80cdda440bb99b3657d5cd55d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Creating volume 3d028dc9-2ec3-44d8-99e1-3375ca261e44 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:56:29 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:29 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 1073741824 Sep 11 13:56:29 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-81cf3e51-2776-4f29-982a-c4b0269abe67 tempest-SnapshotsActionsTest-749365157 None] Create snapshot completed successfully Sep 11 13:56:29 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 1073741824" returned: 0 in 0.520s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:30 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 Sep 11 13:56:30 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:30 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4946c74b-6a4d-4bbe-9c9f-8bd4bf6698ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602a398e-de68-443d-bd9f-957e247de568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:30 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Volume volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 (3d028dc9-2ec3-44d8-99e1-3375ca261e44): created successfully Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602a398e-de68-443d-bd9f-957e247de568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Flow 'volume_create_manager' (8c8e445f-5e81-4f03-9b86-111d50e5541d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8af0e168-ed4e-4e20-a108-9a0bbdc2f4e1 tempest-VolumesServicesTestJSON-1463426353 None] Created volume successfully. Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-cbc4f940-e36f-4a45-b1fe-0a232c424552-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-cbc4f940-e36f-4a45-b1fe-0a232c424552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Acquiring lock "cinder-quobyte-cbc4f940-e36f-4a45-b1fe-0a232c424552" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-cbc4f940-e36f-4a45-b1fe-0a232c424552" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Deleting offline snapshot cbc4f940-e36f-4a45-b1fe-0a232c424552 of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] snapshot_file for this snap is: volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c841ea-5c4c-47cf-907a-a285c17b03a8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:30 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 Sep 11 13:56:30 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:31 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552" returned: 0 in 0.403s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[405a7d2b-8c12-493f-91cf-0dab20062378]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:31 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:31 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Acquiring lock "cinder-3d028dc9-2ec3-44d8-99e1-3375ca261e44-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Lock "cinder-3d028dc9-2ec3-44d8-99e1-3375ca261e44-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Acquiring lock "cinder-quobyte-3d028dc9-2ec3-44d8-99e1-3375ca261e44" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Lock "cinder-quobyte-3d028dc9-2ec3-44d8-99e1-3375ca261e44" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf32e8-4a42-4f30-9ee2-76856d261e27]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:31 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 Sep 11 13:56:31 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:31 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.505s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:31 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 Sep 11 13:56:31 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:32 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44" returned: 0 in 0.576s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:32 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44 Sep 11 13:56:32 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:32 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552" returned: 0 in 0.581s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:32 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552 Sep 11 13:56:32 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:32 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3d028dc9-2ec3-44d8-99e1-3375ca261e44" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Lock "cinder-quobyte-3d028dc9-2ec3-44d8-99e1-3375ca261e44" released by "delete_volume" :: held 0.919s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Created reservations ['b5ed16bf-3ba8-4d1b-b06f-3adb398b048a', 'b7e13548-dbf9-46f2-ad44-83cca9d3e453', '2fd1f258-8bd4-4c8b-b6f2-f58372628056', 'fece8c8c-ad12-4c99-b407-94cca275790b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:32 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:32 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:32 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.cbc4f940-e36f-4a45-b1fe-0a232c424552" returned: 0 in 0.456s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-cbc4f940-e36f-4a45-b1fe-0a232c424552" released by "_delete_snapshot" :: held 2.079s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" released by "delete_snapshot" :: held 2.111s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Created reservations ['d6aa2165-6f80-4555-9b48-226a7d10147d', '3a19d622-edb5-4932-bf42-04f8c5ea8bc9', 'c2b85b8e-14b9-4fd8-b87e-d20917c4a3d1', 'cfaa9230-db73-43d2-9b7f-b96e40f536de'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:32 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.360s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Deleted volume successfully. Sep 11 13:56:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-448e6f47-354a-4c44-b7b5-97201a6ef61e tempest-VolumesServicesTestJSON-1463426353 None] Lock "cinder-3d028dc9-2ec3-44d8-99e1-3375ca261e44-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Delete snapshot completed successfully. Sep 11 13:56:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-282b64d3-6603-4f74-bcdb-d6c151acd646 tempest-SnapshotsActionsTest-1327684335 None] Lock "cinder-cbc4f940-e36f-4a45-b1fe-0a232c424552-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "cinder-ea36ba7d-abae-4bb4-a03e-ebd2480623f4-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-ea36ba7d-abae-4bb4-a03e-ebd2480623f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "cinder-quobyte-ea36ba7d-abae-4bb4-a03e-ebd2480623f4" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-quobyte-ea36ba7d-abae-4bb4-a03e-ebd2480623f4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Deleting offline snapshot ea36ba7d-abae-4bb4-a03e-ebd2480623f4 of volume 3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] snapshot_file for this snap is: volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184e98e-7481-4c9c-ae19-01db2e556dbe]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:34 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:34 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:35 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.589s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b354237-5693-4f65-afc2-ec7551a491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:56:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a2ebba-431d-4a1e-bc96-be170cfccdad]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:35 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 Sep 11 13:56:35 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:35 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1" returned: 0 in 0.536s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:35 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:35 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:36 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.424s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:36 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4 Sep 11 13:56:36 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:36 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1.ea36ba7d-abae-4bb4-a03e-ebd2480623f4" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-quobyte-ea36ba7d-abae-4bb4-a03e-ebd2480623f4" released by "_delete_snapshot" :: held 2.015s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" released by "delete_snapshot" :: held 2.051s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Created reservations ['2a1852a7-ca0d-43af-8ea4-ca10206823ce', '583a862f-3fb1-429a-a46e-3efe31be68aa', '904ca31a-ddd5-401a-8767-b54b989add87', '086d3929-b1d7-4a55-8ef1-6ab02393837a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Delete snapshot completed successfully. Sep 11 13:56:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-df5cabeb-6efe-414a-9b86-02e4bbb9efea tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-ea36ba7d-abae-4bb4-a03e-ebd2480623f4-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "cinder-3b354237-5693-4f65-afc2-ec7551a491b1-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-3b354237-5693-4f65-afc2-ec7551a491b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:56:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:56:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e4199-6d10-4018-8040-11184bc5e118]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:38 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 Sep 11 13:56:38 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:38 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1" returned: 0 in 0.414s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:38 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1 Sep 11 13:56:38 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:38 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b354237-5693-4f65-afc2-ec7551a491b1" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-quobyte-3b354237-5693-4f65-afc2-ec7551a491b1" released by "delete_volume" :: held 0.781s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Created reservations ['7929494b-9156-4953-875c-6becc71800c2', 'b2088e76-1186-46a1-af5b-9602cf84545c', '44f282ef-2a57-4326-ad42-2480f2c85369', '968937c2-3797-4b42-8738-03065d61dbac'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:38 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:56:38 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:39 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.404s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:39 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:56:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Deleted volume successfully. Sep 11 13:56:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292c2233-3845-4f2c-bbb4-18a5f0d1450f tempest-SnapshotsActionsTest-749365157 None] Lock "cinder-3b354237-5693-4f65-afc2-ec7551a491b1-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:56:48 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=117,cinder:SELECT=101,cinder:INSERT=32,cinder:DELETE=10 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:56:49 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=144,cinder:INSERT=45,cinder:UPDATE=185,cinder:DELETE=13 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Flow 'volume_create_manager' (ee35e1f5-8ce3-4e49-bc07-5a1eeb01d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd24852-7e42-4ec7-ae67-d6f7a1b7e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd24852-7e42-4ec7-ae67-d6f7a1b7e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1360265188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5eac2-d0f2-4f7b-81da-f43b2a416ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a65fc50de4163b2e4e8d960525409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:54Z,use_quota=True,user_id='78b43ed6b7914556a7b7b13ab4ea1161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cefc114-9c61-4b82-8688-33c840663544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cefc114-9c61-4b82-8688-33c840663544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9f1b6a-e602-4d3e-aa07-7148c7ea1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9f1b6a-e602-4d3e-aa07-7148c7ea1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d5eac2-d0f2-4f7b-81da-f43b2a416ea3', 'volume_name': 'volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ef0c02-8106-48ca-8d3e-d2541e8119e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ef0c02-8106-48ca-8d3e-d2541e8119e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbab0d5-fa8e-476c-8566-2ed66ddbef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Volume 70d5eac2-d0f2-4f7b-81da-f43b2a416ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3', 'volume_size': 1} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1360265188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5eac2-d0f2-4f7b-81da-f43b2a416ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a65fc50de4163b2e4e8d960525409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:54Z,use_quota=True,user_id='78b43ed6b7914556a7b7b13ab4ea1161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Creating volume 70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:56:54 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:56:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:54 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 1073741824 Sep 11 13:56:54 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:55 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 1073741824" returned: 0 in 0.986s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:55 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 Sep 11 13:56:55 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:56 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbab0d5-fa8e-476c-8566-2ed66ddbef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb54ac0c-0036-47df-a227-75bbbb357cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Volume volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 (70d5eac2-d0f2-4f7b-81da-f43b2a416ea3): created successfully Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb54ac0c-0036-47df-a227-75bbbb357cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Flow 'volume_create_manager' (ee35e1f5-8ce3-4e49-bc07-5a1eeb01d944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-81585f10-172b-43fe-90bc-00d9f621e88c tempest-TestImageHashVerification-559638358 None] Created volume successfully. Sep 11 13:56:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:56:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a08af-6252-496f-844e-2542431c80b4]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:58 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 Sep 11 13:56:58 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:59 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" returned: 0 in 0.723s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbfd8b4-a5b9-4454-bf7e-c51a12b6c23f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:56:59 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 Sep 11 13:56:59 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (f86e32af-65c2-4fb6-a2e4-545d987e511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35451f04-965f-4f1a-a435-cd87d0a3903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35451f04-965f-4f1a-a435-cd87d0a3903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1850044679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563127d1-4011-4f7d-9912-f5bda8f8c936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:59Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d09be39-b1d5-4dad-85c5-7c01f23fdcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d09be39-b1d5-4dad-85c5-7c01f23fdcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231d9a45-f4e8-4aca-8c45-6cea095f4e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231d9a45-f4e8-4aca-8c45-6cea095f4e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563127d1-4011-4f7d-9912-f5bda8f8c936', 'volume_name': 'volume-563127d1-4011-4f7d-9912-f5bda8f8c936', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f2c83f-9f67-4616-842b-717b7e6386a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f2c83f-9f67-4616-842b-717b7e6386a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf9292a-5b82-4106-9d61-cd6621c2cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:56:59 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Volume 563127d1-4011-4f7d-9912-f5bda8f8c936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563127d1-4011-4f7d-9912-f5bda8f8c936', 'volume_size': 1} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:56:59 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" returned: 0 in 0.592s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:56:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 /opt/stack/data/cinder/conversion/70d5eac2-d0f2-4f7b-81da-f43b2a416ea3.temp_image.53c6b7ca-6567-47a9-8183-2b7039562fa8b7otvbgi.img {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:56:59 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 /opt/stack/data/cinder/conversion/70d5eac2-d0f2-4f7b-81da-f43b2a416ea3.temp_image.53c6b7ca-6567-47a9-8183-2b7039562fa8b7otvbgi.img Sep 11 13:56:59 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:06 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 /opt/stack/data/cinder/conversion/70d5eac2-d0f2-4f7b-81da-f43b2a416ea3.temp_image.53c6b7ca-6567-47a9-8183-2b7039562fa8b7otvbgi.img" returned: 0 in 6.724s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d4c36-c7b4-46e7-8ea1-588a9d2c4612]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:06 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 Sep 11 13:57:06 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:07 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" returned: 0 in 0.722s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:07 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/conversion/70d5eac2-d0f2-4f7b-81da-f43b2a416ea3.temp_image.53c6b7ca-6567-47a9-8183-2b7039562fa8b7otvbgi.img {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:57:07 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Converted 1024.00 MB image at 152.26 MB/s Sep 11 13:57:07 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] 53c6b7ca-6567-47a9-8183-2b7039562fa8 was raw, no need to convert to raw {{(pid=88731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:10 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:10 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:10 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.342s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:57:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Flow 'volume_create_manager' (247294ae-a783-4aaa-821a-dc068f7cafbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df6f591-15c6-471c-889f-22e382c5b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df6f591-15c6-471c-889f-22e382c5b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-435220326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd0e6d334f74f0c95e1d8ede933e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:14Z,use_quota=True,user_id='e03c0a61ca634dca94c2467b3deca8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8410bb-bd5a-41f3-9e41-d25763bca643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8410bb-bd5a-41f3-9e41-d25763bca643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19da7bf8-29dd-4082-9956-bb8ea274e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19da7bf8-29dd-4082-9956-bb8ea274e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2', 'volume_name': 'volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4777d9-d72f-4eda-a98b-59056f32c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4777d9-d72f-4eda-a98b-59056f32c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ffaa0a-ce0b-4091-bf85-b6b7682e6ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Volume fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2', 'volume_size': 1} Sep 11 13:57:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Flow 'volume_create_manager' (27f8202f-3b5f-4a27-a013-bebb3ff48f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985191fc-53b7-4bbe-ae13-b7bc2b4dd85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985191fc-53b7-4bbe-ae13-b7bc2b4dd85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1577790737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a32d22-9b31-4398-8f81-5dfd94b9944f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069a52f81b3d4b5b855e59caf3ada3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:15Z,use_quota=True,user_id='4eaad9d50ea44ecaab39877a117d209d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc3b6c1-6560-4904-95ee-e9e22c244edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc3b6c1-6560-4904-95ee-e9e22c244edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba6a8fb-e4fa-4274-b215-fad0841a30d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba6a8fb-e4fa-4274-b215-fad0841a30d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a32d22-9b31-4398-8f81-5dfd94b9944f', 'volume_name': 'volume-57a32d22-9b31-4398-8f81-5dfd94b9944f', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaebda2-9007-4e2c-beaa-49c397d4a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaebda2-9007-4e2c-beaa-49c397d4a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a16b38-8ee1-4a59-b6f2-98a4487e6ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:15 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Volume 57a32d22-9b31-4398-8f81-5dfd94b9944f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a32d22-9b31-4398-8f81-5dfd94b9944f', 'volume_size': 1} Sep 11 13:57:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.529s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Uploaded volume to glance image-id: 53c6b7ca-6567-47a9-8183-2b7039562fa8. {{(pid=88731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.451s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1850044679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563127d1-4011-4f7d-9912-f5bda8f8c936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:56:59Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Creating volume 563127d1-4011-4f7d-9912-f5bda8f8c936 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:29 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:29 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 1073741824 Sep 11 13:57:29 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bcf30d4e-0b76-4eed-af8d-7ceb00fedd6b tempest-TestImageHashVerification-559638358 None] Copy volume to image completed successfully. Sep 11 13:57:29 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 1073741824" returned: 0 in 0.406s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:29 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 Sep 11 13:57:29 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Acquiring lock "cinder-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Lock "cinder-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:29 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.157s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-435220326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd0e6d334f74f0c95e1d8ede933e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:14Z,use_quota=True,user_id='e03c0a61ca634dca94c2467b3deca8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Creating volume fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:29 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:29 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 1073741824 Sep 11 13:57:29 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Acquiring lock "cinder-quobyte-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf9292a-5b82-4106-9d61-cd6621c2cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563127d1-4011-4f7d-9912-f5bda8f8c936', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba55012-7bc2-4ca0-917d-7507666cdcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Lock "cinder-quobyte-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Volume volume-563127d1-4011-4f7d-9912-f5bda8f8c936 (563127d1-4011-4f7d-9912-f5bda8f8c936): created successfully Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba55012-7bc2-4ca0-917d-7507666cdcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (f86e32af-65c2-4fb6-a2e4-545d987e511e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c9283-850e-4ce1-a034-fc1de977cccd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2dfc1775-b5c0-4573-ac77-892fcc2c728f tempest-VolumesActionsTest-401931930 None] Created volume successfully. Sep 11 13:57:29 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 Sep 11 13:57:29 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1faea4bf-9406-45c3-a2a8-9e20c43b9fa5 tempest-VolumesActionsTest-401931930 None] Acquiring lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936" by "attach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1faea4bf-9406-45c3-a2a8-9e20c43b9fa5 tempest-VolumesActionsTest-401931930 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936" acquired by "attach_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:30 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 1073741824" returned: 0 in 0.481s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:30 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" returned: 0 in 0.418s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:30 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3 Sep 11 13:57:30 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1faea4bf-9406-45c3-a2a8-9e20c43b9fa5 tempest-VolumesActionsTest-401931930 None] Attaching volume 563127d1-4011-4f7d-9912-f5bda8f8c936 to instance 732ed950-18d2-4345-acec-07048ef31b3b at mountpoint /dev/vdb on host None. Sep 11 13:57:30 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 Sep 11 13:57:30 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1faea4bf-9406-45c3-a2a8-9e20c43b9fa5 tempest-VolumesActionsTest-401931930 None] Attach volume completed successfully. Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1faea4bf-9406-45c3-a2a8-9e20c43b9fa5 tempest-VolumesActionsTest-401931930 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936" released by "attach_volume" :: held 0.169s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:30 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Lock "cinder-quobyte-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3" released by "delete_volume" :: held 0.749s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:30 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2" returned: 0 in 0.279s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1577790737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a32d22-9b31-4398-8f81-5dfd94b9944f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069a52f81b3d4b5b855e59caf3ada3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:15Z,use_quota=True,user_id='4eaad9d50ea44ecaab39877a117d209d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Creating volume 57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:30 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:30 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f 1073741824 Sep 11 13:57:30 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ffaa0a-ce0b-4091-bf85-b6b7682e6ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa6187b-5843-49d8-9041-8e417b96a9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Created reservations ['070a88c2-8df1-4189-9b13-094e49f36372', 'eacd0b24-2c3e-4253-b497-2385766e6e63', 'caccd229-d055-4b27-8908-da6d645b5c64', '249da5a4-2267-4b62-84a3-fb257adff412'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:30 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Volume volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 (fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2): created successfully Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa6187b-5843-49d8-9041-8e417b96a9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Flow 'volume_create_manager' (247294ae-a783-4aaa-821a-dc068f7cafbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7b0deed8-6e2a-4bde-9bde-b5546b03c861 tempest-VolumesListAdminTestJSON-2018489168 None] Created volume successfully. Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:30 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:30 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-76f22c20-d985-4a7b-9133-c8f114064390 tempest-VolumesActionsTest-1844717591 None] Terminate volume connection completed successfully. Sep 11 13:57:31 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-76f22c20-d985-4a7b-9133-c8f114064390 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-detach_volume" by "detach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Deleted volume successfully. Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-76f22c20-d985-4a7b-9133-c8f114064390 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-76f22c20-d985-4a7b-9133-c8f114064390 tempest-VolumesActionsTest-1844717591 None] Detaching volume 563127d1-4011-4f7d-9912-f5bda8f8c936 from instance 732ed950-18d2-4345-acec-07048ef31b3b. Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24a5901c-4f22-48d2-9389-e71fc9930c50 tempest-TestImageHashVerification-559638358 None] Lock "cinder-70d5eac2-d0f2-4f7b-81da-f43b2a416ea3-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:31 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f 1073741824" returned: 0 in 0.538s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-76f22c20-d985-4a7b-9133-c8f114064390 tempest-VolumesActionsTest-1844717591 None] Detach volume completed successfully. Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-76f22c20-d985-4a7b-9133-c8f114064390 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:31 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f Sep 11 13:57:31 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1616566-c5f0-47ae-9772-c60ce069f7d5 tempest-VolumesActionsTest-401931930 None] Acquiring lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-detach_volume" by "detach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1616566-c5f0-47ae-9772-c60ce069f7d5 tempest-VolumesActionsTest-401931930 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d1616566-c5f0-47ae-9772-c60ce069f7d5 tempest-VolumesActionsTest-401931930 None] Volume detach called, but volume not attached. Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1616566-c5f0-47ae-9772-c60ce069f7d5 tempest-VolumesActionsTest-401931930 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:31 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a16b38-8ee1-4a59-b6f2-98a4487e6ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a32d22-9b31-4398-8f81-5dfd94b9944f', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81863863-660f-4780-876c-5d1d455f0547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Volume volume-57a32d22-9b31-4398-8f81-5dfd94b9944f (57a32d22-9b31-4398-8f81-5dfd94b9944f): created successfully Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81863863-660f-4780-876c-5d1d455f0547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Flow 'volume_create_manager' (27f8202f-3b5f-4a27-a013-bebb3ff48f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-03bdf7d9-95e6-439f-84cd-f412453f04a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Created volume successfully. Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Acquiring lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Acquiring lock "cinder-quobyte-563127d1-4011-4f7d-9912-f5bda8f8c936" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Lock "cinder-quobyte-563127d1-4011-4f7d-9912-f5bda8f8c936" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad687ef-8f7b-40f9-adf9-948f6c252a38]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:31 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 Sep 11 13:57:31 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Flow 'volume_create_manager' (8a2e36c9-0026-4532-85da-9d8eebbcfe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e95f50c-1620-4faf-8883-da5d0a3938fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e95f50c-1620-4faf-8883-da5d0a3938fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1873753980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65042a4c-9e7a-4d23-91d4-65bc1d90e703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd0e6d334f74f0c95e1d8ede933e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:32Z,use_quota=True,user_id='e03c0a61ca634dca94c2467b3deca8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fa878e-149d-4fa2-89be-9500f3f97fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fa878e-149d-4fa2-89be-9500f3f97fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4906044a-64f0-43de-b3ee-b36ae60220d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4906044a-64f0-43de-b3ee-b36ae60220d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65042a4c-9e7a-4d23-91d4-65bc1d90e703', 'volume_name': 'volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c05114-7ad5-4bae-9f64-ece1bd741ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c05114-7ad5-4bae-9f64-ece1bd741ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:32 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580d6b03-f6c3-4ac8-84e0-6241a905760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Volume 65042a4c-9e7a-4d23-91d4-65bc1d90e703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703', 'volume_size': 1} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1873753980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65042a4c-9e7a-4d23-91d4-65bc1d90e703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd0e6d334f74f0c95e1d8ede933e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:32Z,use_quota=True,user_id='e03c0a61ca634dca94c2467b3deca8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Creating volume 65042a4c-9e7a-4d23-91d4-65bc1d90e703 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:32 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936" returned: 0 in 0.396s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:32 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 1073741824 Sep 11 13:57:32 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:32 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936 Sep 11 13:57:32 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:32 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-563127d1-4011-4f7d-9912-f5bda8f8c936" returned: 0 in 0.323s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Lock "cinder-quobyte-563127d1-4011-4f7d-9912-f5bda8f8c936" released by "delete_volume" :: held 0.772s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Created reservations ['a95f00b4-7202-4924-b114-881949db561a', 'ccd8a8f3-cab8-4dc4-9fc5-526e3792fa04', '2cbc84a6-c32a-4cbc-b85f-fae7927c0dbc', '5e07b0ab-a52e-431c-832e-0a17f54231df'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:32 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:32 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:32 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 1073741824" returned: 0 in 0.574s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:32 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 Sep 11 13:57:32 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:33 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Deleted volume successfully. Sep 11 13:57:33 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703" returned: 0 in 0.340s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.450s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-02885f07-3604-4230-a24f-5847c85f5030 tempest-VolumesActionsTest-401931930 None] Lock "cinder-563127d1-4011-4f7d-9912-f5bda8f8c936-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580d6b03-f6c3-4ac8-84e0-6241a905760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee937efe-d58a-4459-aa83-37132280de59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Creating offline snapshot 053515aa-87a9-4535-b2dd-c9b6af06a276 of volume 57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:57:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Volume volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 (65042a4c-9e7a-4d23-91d4-65bc1d90e703): created successfully Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee937efe-d58a-4459-aa83-37132280de59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Flow 'volume_create_manager' (8a2e36c9-0026-4532-85da-9d8eebbcfe39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aafe09-1734-431e-bf39-37f48e491f90]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9a0c8f56-f343-45f6-8ea2-8f71fe946e12 tempest-VolumesListAdminTestJSON-2018489168 None] Created volume successfully. Sep 11 13:57:33 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f Sep 11 13:57:33 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:33 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f" returned: 0 in 0.577s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:33 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 1G Sep 11 13:57:33 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:34 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 1G" returned: 0 in 0.551s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57a32d22-9b31-4398-8f81-5dfd94b9944f -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:34 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57a32d22-9b31-4398-8f81-5dfd94b9944f -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 Sep 11 13:57:34 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:34 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57a32d22-9b31-4398-8f81-5dfd94b9944f -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276" returned: 0 in 0.502s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:34 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 is being set with open permissions: ugo+rw Sep 11 13:57:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:34 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 Sep 11 13:57:34 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Flow 'volume_create_manager' (fbdf8348-fcd8-48ac-931d-c26938b69738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cfe07d-2d78-42bd-9d56-1d19a8abb757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cfe07d-2d78-42bd-9d56-1d19a8abb757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1697815266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc58660d-0891-4bbc-91b6-723fba9cf379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd0e6d334f74f0c95e1d8ede933e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:35Z,use_quota=True,user_id='e03c0a61ca634dca94c2467b3deca8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:35 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075b39a6-cd96-45e0-ba87-953f33d7a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075b39a6-cd96-45e0-ba87-953f33d7a01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ce9105-9aab-434e-8546-96842dd296bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ce9105-9aab-434e-8546-96842dd296bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc58660d-0891-4bbc-91b6-723fba9cf379', 'volume_name': 'volume-dc58660d-0891-4bbc-91b6-723fba9cf379', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a03e83-fbfc-4471-9332-f583ae51932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a03e83-fbfc-4471-9332-f583ae51932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca34458b-8053-46b3-8fe3-e5b5abac22f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:35 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Volume dc58660d-0891-4bbc-91b6-723fba9cf379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc58660d-0891-4bbc-91b6-723fba9cf379', 'volume_size': 1} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276" returned: 0 in 0.318s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:35 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info Sep 11 13:57:35 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:35 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:35 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info is being set with open permissions: ugo+rw Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:35 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info Sep 11 13:57:35 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:35 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.info" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1697815266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc58660d-0891-4bbc-91b6-723fba9cf379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd0e6d334f74f0c95e1d8ede933e009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:35Z,use_quota=True,user_id='e03c0a61ca634dca94c2467b3deca8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Creating volume dc58660d-0891-4bbc-91b6-723fba9cf379 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:35 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:35 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 1073741824 Sep 11 13:57:35 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e4effa6b-f6df-4a02-b91a-399d9acc37ad tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Create snapshot completed successfully Sep 11 13:57:36 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 1073741824" returned: 0 in 0.636s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:36 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 Sep 11 13:57:36 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "cinder-053515aa-87a9-4535-b2dd-c9b6af06a276-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-053515aa-87a9-4535-b2dd-c9b6af06a276-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "cinder-quobyte-57a32d22-9b31-4398-8f81-5dfd94b9944f" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-quobyte-57a32d22-9b31-4398-8f81-5dfd94b9944f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "cinder-quobyte-053515aa-87a9-4535-b2dd-c9b6af06a276" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-quobyte-053515aa-87a9-4535-b2dd-c9b6af06a276" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Deleting offline snapshot 053515aa-87a9-4535-b2dd-c9b6af06a276 of volume 57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] snapshot_file for this snap is: volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330f5bb-f5db-4abb-9a64-3dd1d4582b1a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (3b241f89-3947-4931-9935-0e7f65c2f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c5b256-0cd8-4bee-8372-3f0b5605c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c5b256-0cd8-4bee-8372-3f0b5605c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-760375901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dffaf7-a5e4-4c08-ac0c-4315bd9f1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:37Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:36 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef3e445-1ee3-4e21-925f-7616e0b3f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef3e445-1ee3-4e21-925f-7616e0b3f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e0cc3-3431-43c2-a81a-97ec3272fea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e0cc3-3431-43c2-a81a-97ec3272fea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34dffaf7-a5e4-4c08-ac0c-4315bd9f1458', 'volume_name': 'volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f94e572-e99b-4463-9f95-923bfad3e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f94e572-e99b-4463-9f95-923bfad3e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c0c0a3-c871-4dbc-a2f9-f9eaeb87d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:36 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Volume 34dffaf7-a5e4-4c08-ac0c-4315bd9f1458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458', 'volume_size': 1} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379" returned: 0 in 0.454s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:36 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:36 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-760375901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dffaf7-a5e4-4c08-ac0c-4315bd9f1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:37Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Creating volume 34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:36 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca34458b-8053-46b3-8fe3-e5b5abac22f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc58660d-0891-4bbc-91b6-723fba9cf379', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ae55cb-a23b-4e97-9da8-1149d366fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:36 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 1073741824 Sep 11 13:57:36 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:36 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Volume volume-dc58660d-0891-4bbc-91b6-723fba9cf379 (dc58660d-0891-4bbc-91b6-723fba9cf379): created successfully Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ae55cb-a23b-4e97-9da8-1149d366fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Flow 'volume_create_manager' (fbdf8348-fcd8-48ac-931d-c26938b69738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:37 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7ce4271d-2504-4143-86f7-9e350b2f5aba tempest-VolumesListAdminTestJSON-2018489168 None] Created volume successfully. Sep 11 13:57:37 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276" returned: 0 in 0.494s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57a32d22-9b31-4398-8f81-5dfd94b9944f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ca6dbd-d5aa-4db6-a2df-7f83938694f3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:37 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f Sep 11 13:57:37 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:37 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 1073741824" returned: 0 in 0.544s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:37 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 Sep 11 13:57:37 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:37 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f" returned: 0 in 0.490s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:37 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 Sep 11 13:57:37 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:37 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458" returned: 0 in 0.408s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c0c0a3-c871-4dbc-a2f9-f9eaeb87d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229481c0-6208-44cc-99a0-726e458d3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:37 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Volume volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 (34dffaf7-a5e4-4c08-ac0c-4315bd9f1458): created successfully Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229481c0-6208-44cc-99a0-726e458d3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (3b241f89-3947-4931-9935-0e7f65c2f378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-40db4ab0-7c95-48a0-8a0a-409453bd0664 tempest-VolumesActionsTest-401931930 None] Created volume successfully. Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Flow 'volume_create_manager' (d8b51022-c327-4a1e-909e-e0a320b7c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de6d9c2-f231-40d5-afed-e29bdae501a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de6d9c2-f231-40d5-afed-e29bdae501a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8644606-6c3e-4f6a-bcec-37ce0a253e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8707d8978af14798a7563c8a5114047b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:38Z,use_quota=True,user_id='2682689d82ab405ab1b3fc1fcf2f81c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6671f0d4-b6d0-4d44-9d0c-5a126f67daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6671f0d4-b6d0-4d44-9d0c-5a126f67daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c23dda8-b076-423d-be9d-bfb76aefccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c23dda8-b076-423d-be9d-bfb76aefccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8644606-6c3e-4f6a-bcec-37ce0a253e51', 'volume_name': 'volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57b47f0-7810-4379-8cfe-13d5adf158de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57b47f0-7810-4379-8cfe-13d5adf158de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2041b2-6e5f-4471-b196-cfa71881b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:38 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Volume d8644606-6c3e-4f6a-bcec-37ce0a253e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51', 'volume_size': 1} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8644606-6c3e-4f6a-bcec-37ce0a253e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8707d8978af14798a7563c8a5114047b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:38Z,use_quota=True,user_id='2682689d82ab405ab1b3fc1fcf2f81c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Creating volume d8644606-6c3e-4f6a-bcec-37ce0a253e51 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:38 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:38 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:38 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 1073741824 Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276" returned: 0 in 0.442s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:38 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:38 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276 Sep 11 13:57:38 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:38 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f.053515aa-87a9-4535-b2dd-c9b6af06a276" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-quobyte-053515aa-87a9-4535-b2dd-c9b6af06a276" released by "_delete_snapshot" :: held 1.822s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-quobyte-57a32d22-9b31-4398-8f81-5dfd94b9944f" released by "delete_snapshot" :: held 1.862s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Created reservations ['bf72a9e1-33c6-41e9-b715-b8ea8d7bbe32', 'e7f1ab7f-17bd-4de1-ae89-f5eadb385273', '589196d8-011f-4cea-8e9d-884873f33d79', '903dece7-50f2-4258-a8b7-773526710665'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:38 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 1073741824" returned: 0 in 0.459s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Delete snapshot completed successfully. Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e663127-164f-495b-a01c-eff2028c30bb tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-053515aa-87a9-4535-b2dd-c9b6af06a276-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:38 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 Sep 11 13:57:38 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "cinder-57a32d22-9b31-4398-8f81-5dfd94b9944f-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-57a32d22-9b31-4398-8f81-5dfd94b9944f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "cinder-quobyte-57a32d22-9b31-4398-8f81-5dfd94b9944f" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-quobyte-57a32d22-9b31-4398-8f81-5dfd94b9944f" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5ed25-9d57-48c6-aecd-69b8629ed395]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:39 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51" returned: 0 in 0.475s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2041b2-6e5f-4471-b196-cfa71881b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc6eb8e-0990-4a28-aea9-ed7f557698dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:39 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Volume volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 (d8644606-6c3e-4f6a-bcec-37ce0a253e51): created successfully Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc6eb8e-0990-4a28-aea9-ed7f557698dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Flow 'volume_create_manager' (d8b51022-c327-4a1e-909e-e0a320b7c11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-quobyte-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ca384461-1d02-4b43-bc6d-2653463ca2f6 tempest-VolumesListAdminTestJSON-2057021306 None] Created volume successfully. Sep 11 13:57:39 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f Sep 11 13:57:39 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bbe1f8-42ca-4eca-bc29-f056151fdf09]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:39 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 Sep 11 13:57:39 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:39 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f" returned: 0 in 0.412s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:39 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f Sep 11 13:57:39 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:39 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458" returned: 0 in 0.387s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:39 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458 Sep 11 13:57:39 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:39 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57a32d22-9b31-4398-8f81-5dfd94b9944f" returned: 0 in 0.289s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-quobyte-57a32d22-9b31-4398-8f81-5dfd94b9944f" released by "delete_volume" :: held 0.776s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Created reservations ['464ed873-9118-4714-9c43-07d256389af3', '3b910eeb-3f51-4876-8d52-7dae36f91688', 'e3877a0f-28e3-49f8-bf12-9670cc48cd4d', 'd1ee24d8-56fa-44ba-b798-3f2d8700453a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:39 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458" released by "delete_volume" :: held 0.717s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:40 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:40 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Created reservations ['e0a4fbdb-c6aa-4c9d-a302-41fb1152781d', 'f925f3cd-84d8-4fba-87e5-f9882bde77a3', '53e4b88d-93a0-430e-944e-5535b4083f47', 'fd7524b1-7350-46ce-a920-a1db0c54bed3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:40 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:40 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:40 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.353s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Deleted volume successfully. Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Acquiring lock "cinder-d8644606-6c3e-4f6a-bcec-37ce0a253e51-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b5201f4a-91d6-4944-9971-f8c0d6a36914 tempest-VolumeSnapshotQuotasNegativeTestJSON-655654209 None] Lock "cinder-57a32d22-9b31-4398-8f81-5dfd94b9944f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Lock "cinder-d8644606-6c3e-4f6a-bcec-37ce0a253e51-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Acquiring lock "cinder-quobyte-d8644606-6c3e-4f6a-bcec-37ce0a253e51" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Lock "cinder-quobyte-d8644606-6c3e-4f6a-bcec-37ce0a253e51" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "cinder-dc58660d-0891-4bbc-91b6-723fba9cf379-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[450c7fc6-8d83-4adc-94a6-7cb33f5e08c5]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:40 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-dc58660d-0891-4bbc-91b6-723fba9cf379-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.448s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Deleted volume successfully. Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e38fc6db-827c-4e22-9739-3a59b1b6ac29 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-34dffaf7-a5e4-4c08-ac0c-4315bd9f1458-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "cinder-quobyte-dc58660d-0891-4bbc-91b6-723fba9cf379" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:40 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 Sep 11 13:57:40 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-quobyte-dc58660d-0891-4bbc-91b6-723fba9cf379" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a426dc-0ead-4a42-a72a-d284bcbba023]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:40 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 Sep 11 13:57:40 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:41 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51" returned: 0 in 0.589s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:41 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51 Sep 11 13:57:41 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (7c2485d6-a6c3-4c16-879f-9b39213bbe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90262a5c-f1c9-4a78-a0e1-b4052af60bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90262a5c-f1c9-4a78-a0e1-b4052af60bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-266128371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5059a5fd-53e5-4cb9-bf83-4d704454f4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:41Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:41 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8654ca-df8a-46c9-b2a2-7cd7e8de4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8654ca-df8a-46c9-b2a2-7cd7e8de4e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0145227d-6cc9-4eef-a90d-015f3199fb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0145227d-6cc9-4eef-a90d-015f3199fb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5059a5fd-53e5-4cb9-bf83-4d704454f4db', 'volume_name': 'volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13749b58-d680-4d00-8c8d-f29f150755b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13749b58-d680-4d00-8c8d-f29f150755b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dac4874-c79b-4b24-a6f1-688e99aa552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:41 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Volume 5059a5fd-53e5-4cb9-bf83-4d704454f4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db', 'volume_size': 1} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-266128371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5059a5fd-53e5-4cb9-bf83-4d704454f4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:41Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Creating volume 5059a5fd-53e5-4cb9-bf83-4d704454f4db {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:41 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379" returned: 0 in 0.551s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:41 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db 1073741824 Sep 11 13:57:41 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:41 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379 Sep 11 13:57:41 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:41 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d8644606-6c3e-4f6a-bcec-37ce0a253e51" returned: 0 in 0.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Lock "cinder-quobyte-d8644606-6c3e-4f6a-bcec-37ce0a253e51" released by "delete_volume" :: held 1.093s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:41 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dc58660d-0891-4bbc-91b6-723fba9cf379" returned: 0 in 0.389s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Created reservations ['0aa3559e-1e60-4ad7-81b4-12acf5d1168d', 'f63436ef-e706-4333-9171-7bbfdbf457ed', '5fb33a9b-b595-4753-9b5d-83f628c254a1', 'e6b88fce-d5f5-4d44-a1ee-e9ce7c19eb3e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-quobyte-dc58660d-0891-4bbc-91b6-723fba9cf379" released by "delete_volume" :: held 0.997s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Created reservations ['1c752159-5026-4ce6-8aee-1b611f85d5f5', '03db6a4b-d059-4207-bff4-4906eb4041a1', '3bddcbf9-b202-48f6-82ff-2d1a9c642e80', '19a3f06f-b585-4b0e-acf3-c781e4fa280f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:41 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:41 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:41 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db 1073741824" returned: 0 in 0.650s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:42 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:42 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:42 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db Sep 11 13:57:42 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:42 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.431s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Deleted volume successfully. Sep 11 13:57:42 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Deleted volume successfully. Sep 11 13:57:42 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8dd1211-bd86-450b-9394-8b8c95afa43d tempest-VolumesListAdminTestJSON-2057021306 None] Lock "cinder-d8644606-6c3e-4f6a-bcec-37ce0a253e51-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db" returned: 0 in 0.334s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dac4874-c79b-4b24-a6f1-688e99aa552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2192e7-f966-44de-b42d-f12d553a53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-36daf771-19a5-4413-b5c8-a92899dd664e tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-dc58660d-0891-4bbc-91b6-723fba9cf379-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:42 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Volume volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db (5059a5fd-53e5-4cb9-bf83-4d704454f4db): created successfully Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2192e7-f966-44de-b42d-f12d553a53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (7c2485d6-a6c3-4c16-879f-9b39213bbe4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-96fee59f-7ed9-422d-96c2-4935ef8c5a52 tempest-VolumesActionsTest-401931930 None] Created volume successfully. Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "cinder-65042a4c-9e7a-4d23-91d4-65bc1d90e703-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-65042a4c-9e7a-4d23-91d4-65bc1d90e703-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "cinder-quobyte-65042a4c-9e7a-4d23-91d4-65bc1d90e703" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-quobyte-65042a4c-9e7a-4d23-91d4-65bc1d90e703" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf185a7e-44d6-4cb6-b9d3-ff7b94f4c31a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:43 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 Sep 11 13:57:43 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:43 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703" returned: 0 in 0.441s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-5059a5fd-53e5-4cb9-bf83-4d704454f4db-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:43 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703 Sep 11 13:57:43 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-5059a5fd-53e5-4cb9-bf83-4d704454f4db-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-quobyte-5059a5fd-53e5-4cb9-bf83-4d704454f4db" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-5059a5fd-53e5-4cb9-bf83-4d704454f4db" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d71f2-46d8-4d23-81fc-7edbbff179f5]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:43 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db Sep 11 13:57:43 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:43 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-65042a4c-9e7a-4d23-91d4-65bc1d90e703" returned: 0 in 0.379s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-quobyte-65042a4c-9e7a-4d23-91d4-65bc1d90e703" released by "delete_volume" :: held 0.876s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Created reservations ['8a1a6309-8302-4eda-8119-79d914d32e32', '1452ca21-cf07-48da-bb00-81e185272e37', '2870348c-9a8a-457b-aed3-671fca4553a3', '3c1f9b98-5515-4e37-9d95-e7beec24aaa7'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:44 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:44 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:44 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:44 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db Sep 11 13:57:44 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "cinder-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "cinder-quobyte-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-quobyte-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a619a76-6a9d-4641-ba1d-b5b68f5c85fa]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:44 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.424s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Deleted volume successfully. Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbd1b997-eb06-4e63-8d5c-6cb7523b1721 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-65042a4c-9e7a-4d23-91d4-65bc1d90e703-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:44 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5059a5fd-53e5-4cb9-bf83-4d704454f4db" returned: 0 in 0.379s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-5059a5fd-53e5-4cb9-bf83-4d704454f4db" released by "delete_volume" :: held 0.975s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:44 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 Sep 11 13:57:44 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Created reservations ['2695d4da-964a-404e-959d-520f99590bf9', 'd3e42518-1745-47e7-8f3e-3c486cda5869', '3106911a-2992-4187-a8b1-546b4f457c57', 'd58a4b9b-c360-4d8f-bd3c-b61cb147674b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:44 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:44 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:44 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2" returned: 0 in 0.542s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:45 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2 Sep 11 13:57:45 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:45 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.301s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:45 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Deleted volume successfully. Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-05a1c619-9dc0-49f2-9250-970d8777f192 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-5059a5fd-53e5-4cb9-bf83-4d704454f4db-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:45 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2" returned: 0 in 0.298s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-quobyte-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2" released by "delete_volume" :: held 0.899s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Created reservations ['7db0cb01-b7a7-46b9-93bb-fb5b7047dea1', '43ff996d-9065-4fee-b919-fc3354bf1f01', 'c7ef09b3-7db1-4833-8375-0571e1ecc087', 'b04039a0-ecf7-4b4a-9042-484f7fbb8e36'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:45 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:45 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:45 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.279s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:45 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Deleted volume successfully. Sep 11 13:57:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b0c77a1e-fb11-485a-965b-4e16061de0a2 tempest-VolumesListAdminTestJSON-2018489168 None] Lock "cinder-fd95821f-6d07-4ef7-9bb1-ce8cb48df0c2-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (da38b4e3-b519-4c4a-a969-b61c9ead6ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4eb8cb-1725-4be9-80bb-e8f3bbf02dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4eb8cb-1725-4be9-80bb-e8f3bbf02dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-149227462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c97a9-bcd1-4385-b45b-6022125a97b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:46Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2456b4b7-3d40-442a-9198-f537255cba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2456b4b7-3d40-442a-9198-f537255cba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a80f6d-0d17-4520-8084-b9a2a6c09e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a80f6d-0d17-4520-8084-b9a2a6c09e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027c97a9-bcd1-4385-b45b-6022125a97b7', 'volume_name': 'volume-027c97a9-bcd1-4385-b45b-6022125a97b7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d387609-c6ad-48d4-b49f-eb227c8e61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d387609-c6ad-48d4-b49f-eb227c8e61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195bddb3-4418-45bf-9456-f866c07d95da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:46 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Volume 027c97a9-bcd1-4385-b45b-6022125a97b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027c97a9-bcd1-4385-b45b-6022125a97b7', 'volume_size': 1} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-149227462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c97a9-bcd1-4385-b45b-6022125a97b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:46Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Creating volume 027c97a9-bcd1-4385-b45b-6022125a97b7 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:46 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:46 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 1073741824 Sep 11 13:57:46 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:46 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 1073741824" returned: 0 in 0.477s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:47 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 Sep 11 13:57:47 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:47 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7" returned: 0 in 0.338s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195bddb3-4418-45bf-9456-f866c07d95da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027c97a9-bcd1-4385-b45b-6022125a97b7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7552a2b-7912-45a0-b035-4e2c34505ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:47 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Volume volume-027c97a9-bcd1-4385-b45b-6022125a97b7 (027c97a9-bcd1-4385-b45b-6022125a97b7): created successfully Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7552a2b-7912-45a0-b035-4e2c34505ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (da38b4e3-b519-4c4a-a969-b61c9ead6ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:47 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b31efd57-7dcf-4a85-89c4-3d2a724ad6c3 tempest-VolumesActionsTest-401931930 None] Created volume successfully. Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (bd2aa024-c45c-441a-9b9d-e880bdc3850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55888fac-b62a-4c4d-aeec-fced001b66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55888fac-b62a-4c4d-aeec-fced001b66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-863146588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b853ad-5999-49ce-9bde-0202f6a6c363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:48Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcfd5ba-0c13-4de6-af46-67d1cb647773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcfd5ba-0c13-4de6-af46-67d1cb647773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053233cb-22ba-4a15-b29a-fc9af33125a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053233cb-22ba-4a15-b29a-fc9af33125a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b853ad-5999-49ce-9bde-0202f6a6c363', 'volume_name': 'volume-08b853ad-5999-49ce-9bde-0202f6a6c363', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38c5625-0dc7-4b1d-8506-0509f2cef784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38c5625-0dc7-4b1d-8506-0509f2cef784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510adcf9-d504-4576-8541-68ec0f4ff683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:47 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Volume 08b853ad-5999-49ce-9bde-0202f6a6c363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b853ad-5999-49ce-9bde-0202f6a6c363', 'volume_size': 1} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-863146588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b853ad-5999-49ce-9bde-0202f6a6c363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:48Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Creating volume 08b853ad-5999-49ce-9bde-0202f6a6c363 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:47 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:47 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 1073741824 Sep 11 13:57:47 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (f2fd1e51-9ac7-4886-948d-a96293fbe236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e20325-ee4d-4ba6-8bd1-8de934e6edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e20325-ee4d-4ba6-8bd1-8de934e6edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190121652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d3acce-c121-49ad-9f4b-d28a4f65b83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:48Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0214c2fd-5145-4169-9653-e24e591be211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0214c2fd-5145-4169-9653-e24e591be211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bfdd5b-f5db-465a-9677-48229e9ce96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bfdd5b-f5db-465a-9677-48229e9ce96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d3acce-c121-49ad-9f4b-d28a4f65b83c', 'volume_name': 'volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f0f4c-826e-43b8-974e-389c1dc88a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4f0f4c-826e-43b8-974e-389c1dc88a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cbcc48-ff66-4c56-8ac7-57d58a8ffa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Volume 19d3acce-c121-49ad-9f4b-d28a4f65b83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c', 'volume_size': 1} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:48 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 1073741824" returned: 0 in 0.714s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:48 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 Sep 11 13:57:48 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (6f4526aa-4fd5-4d73-9993-1a2e43f01503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e0ab7a-7a82-4b05-8313-8deaaba99bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e0ab7a-7a82-4b05-8313-8deaaba99bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-266480237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31157443-c97b-484b-bfcd-8e73832fa998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:49Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68bb866-d403-409b-b491-26099852e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68bb866-d403-409b-b491-26099852e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7eb24f-de8a-40b1-a1a9-619eb400da2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7eb24f-de8a-40b1-a1a9-619eb400da2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31157443-c97b-484b-bfcd-8e73832fa998', 'volume_name': 'volume-31157443-c97b-484b-bfcd-8e73832fa998', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4846a4c0-6da4-4c50-83af-68c0c7ab1dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4846a4c0-6da4-4c50-83af-68c0c7ab1dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a080cc9-7cca-4d8e-88df-f838516c2262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Volume 31157443-c97b-484b-bfcd-8e73832fa998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31157443-c97b-484b-bfcd-8e73832fa998', 'volume_size': 1} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:48 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363" returned: 0 in 0.391s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190121652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d3acce-c121-49ad-9f4b-d28a4f65b83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:48Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Creating volume 19d3acce-c121-49ad-9f4b-d28a4f65b83c {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:48 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:48 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=90,cinder:UPDATE=119,cinder:DELETE=8,cinder:INSERT=25 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:57:49 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c 1073741824 Sep 11 13:57:49 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510adcf9-d504-4576-8541-68ec0f4ff683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b853ad-5999-49ce-9bde-0202f6a6c363', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a8b89b-bdb6-4c4e-a53d-e44afcb13808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Volume volume-08b853ad-5999-49ce-9bde-0202f6a6c363 (08b853ad-5999-49ce-9bde-0202f6a6c363): created successfully Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a8b89b-bdb6-4c4e-a53d-e44afcb13808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (bd2aa024-c45c-441a-9b9d-e880bdc3850d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9f4c24db-a926-4d9a-8399-2ee8724af7ef tempest-CreateVolumesFromImageTest-77336000 None] Created volume successfully. Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (073ca125-16a8-4fa8-8a7c-25a875f2cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90549969-65cc-4fc3-83fe-fc42d6a82d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90549969-65cc-4fc3-83fe-fc42d6a82d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803837608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94230d52-ed80-4a9a-b62c-e7693faa3601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:49Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841d3668-f0b8-4bc9-8160-95b05271d3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841d3668-f0b8-4bc9-8160-95b05271d3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04034eec-aec2-4374-8f94-908fe404a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04034eec-aec2-4374-8f94-908fe404a67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94230d52-ed80-4a9a-b62c-e7693faa3601', 'volume_name': 'volume-94230d52-ed80-4a9a-b62c-e7693faa3601', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f43f37-7245-4400-9056-48979603700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f43f37-7245-4400-9056-48979603700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6714628-2175-4460-bd26-f1ed037b3657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Volume 94230d52-ed80-4a9a-b62c-e7693faa3601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94230d52-ed80-4a9a-b62c-e7693faa3601', 'volume_size': 1} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-027c97a9-bcd1-4385-b45b-6022125a97b7-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-027c97a9-bcd1-4385-b45b-6022125a97b7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=89,cinder:UPDATE=116,cinder:INSERT=29,cinder:DELETE=12 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-quobyte-027c97a9-bcd1-4385-b45b-6022125a97b7" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-027c97a9-bcd1-4385-b45b-6022125a97b7" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace176d-2090-4c91-ae80-4b0f3df750d4]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:49 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:49 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 Sep 11 13:57:49 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (df6ed188-a974-4b9f-b05c-1c0dbf9661a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c59bcd1-6638-4498-a658-f9f0a28cbad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c 1073741824" returned: 0 in 0.866s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c59bcd1-6638-4498-a658-f9f0a28cbad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667584587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de54326-fb0a-4e69-a0b3-6e30f0ee4eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:50Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11ef239-a6ec-490f-b71b-597a6a9f6c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11ef239-a6ec-490f-b71b-597a6a9f6c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05482a3-80b1-483f-b49f-b9a2d56b493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05482a3-80b1-483f-b49f-b9a2d56b493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de54326-fb0a-4e69-a0b3-6e30f0ee4eea', 'volume_name': 'volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9769f5bc-a85c-4f36-8055-38b63bd5120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9769f5bc-a85c-4f36-8055-38b63bd5120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396075c0-b1a2-4217-9542-bf0611a2e87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Volume 7de54326-fb0a-4e69-a0b3-6e30f0ee4eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea', 'volume_size': 1} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:50 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c Sep 11 13:57:50 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:50 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7" returned: 0 in 0.425s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:50 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7 Sep 11 13:57:50 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:50 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-266480237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31157443-c97b-484b-bfcd-8e73832fa998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:49Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Creating volume 31157443-c97b-484b-bfcd-8e73832fa998 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:50 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cbcc48-ff66-4c56-8ac7-57d58a8ffa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b0cbf8-6412-49ba-a5f8-e01ecf844d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:50 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 1073741824 Sep 11 13:57:50 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:50 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Volume volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c (19d3acce-c121-49ad-9f4b-d28a4f65b83c): created successfully Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b0cbf8-6412-49ba-a5f8-e01ecf844d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (f2fd1e51-9ac7-4886-948d-a96293fbe236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-003651ce-5b52-4e99-bb9f-f8cf11cc3be9 tempest-CreateVolumesFromImageTest-77336000 None] Created volume successfully. Sep 11 13:57:50 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-027c97a9-bcd1-4385-b45b-6022125a97b7" returned: 0 in 0.321s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-027c97a9-bcd1-4385-b45b-6022125a97b7" released by "delete_volume" :: held 0.806s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Flow 'volume_create_manager' (ee8aafcc-41d4-4f13-8c1a-89df69d05981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49625aa-93e7-4f93-bd7a-bfa45275fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49625aa-93e7-4f93-bd7a-bfa45275fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2030767527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4094e3a184645f88fd1e2c9fdc5eddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:50Z,use_quota=True,user_id='4e8069b867c64b9ebcab528a8f4df4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cc659ae-848a-4bea-9c82-f8464ae450d9),volume_type_id=4cc659ae-848a-4bea-9c82-f8464ae450d9)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65403494-6ed1-455f-8682-eaf3fb85040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65403494-6ed1-455f-8682-eaf3fb85040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d4e1cc-665a-4e8b-bdbf-581d06cb9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d4e1cc-665a-4e8b-bdbf-581d06cb9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8', 'volume_name': 'volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3991b873-48fd-4ea2-a4bd-32b128cdacf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3991b873-48fd-4ea2-a4bd-32b128cdacf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28548b9-6f77-4260-903f-7b1c3f3fa7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:50 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Volume 2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8', 'volume_size': 1} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Created reservations ['c9c96e62-55e3-4316-a8fb-4566890930e4', 'ea99c4c5-2c30-4551-aa8d-004b3434651d', 'f3bb3357-c4c3-4492-a041-c9d2b52b9c09', '64ce2782-8bf0-4ff4-b204-e578c6091beb'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:50 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:50 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:50 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 1073741824" returned: 0 in 0.578s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:50 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 Sep 11 13:57:50 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:50 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:50 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Deleted volume successfully. Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c5d5d712-b302-4356-8c51-dc49b86322f0 tempest-VolumesActionsTest-1844717591 None] Lock "cinder-027c97a9-bcd1-4385-b45b-6022125a97b7-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:51 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803837608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94230d52-ed80-4a9a-b62c-e7693faa3601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:49Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Creating volume 94230d52-ed80-4a9a-b62c-e7693faa3601 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:51 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:51 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 1073741824 Sep 11 13:57:51 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a080cc9-7cca-4d8e-88df-f838516c2262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31157443-c97b-484b-bfcd-8e73832fa998', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c9f135-acf1-4af7-ab41-49f645384a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:51 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Volume volume-31157443-c97b-484b-bfcd-8e73832fa998 (31157443-c97b-484b-bfcd-8e73832fa998): created successfully Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c9f135-acf1-4af7-ab41-49f645384a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (6f4526aa-4fd5-4d73-9993-1a2e43f01503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (8267437b-ca1a-45f9-8396-62818fc2412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c136d90f-c3ff-417b-8e9c-65eeb8ef2ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c136d90f-c3ff-417b-8e9c-65eeb8ef2ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002226948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3454e6-972c-4b5f-8186-1e9cf7bd55ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:51Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bd4ca5-1c93-454c-b415-af755715f9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bd4ca5-1c93-454c-b415-af755715f9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67543359-e316-4158-b8f6-cc91e52aaa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67543359-e316-4158-b8f6-cc91e52aaa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3454e6-972c-4b5f-8186-1e9cf7bd55ae', 'volume_name': 'volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01057fc-5b91-4873-bb50-9f78bd0fcd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01057fc-5b91-4873-bb50-9f78bd0fcd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad37d7a-c36d-49e7-b997-863cd68d9dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:51 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Volume dd3454e6-972c-4b5f-8186-1e9cf7bd55ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae', 'volume_size': 1} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-793e838d-1d65-4619-8384-7dc5fc8a86e0 tempest-CreateVolumesFromImageTest-77336000 None] Created volume successfully. Sep 11 13:57:51 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 1073741824" returned: 0 in 0.442s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:51 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 Sep 11 13:57:51 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:51 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601" returned: 0 in 0.252s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667584587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de54326-fb0a-4e69-a0b3-6e30f0ee4eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370b6019da34c2eb99b69d87627c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:50Z,use_quota=True,user_id='f5f3a239f0864ff995e7c9d0881e5e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Creating volume 7de54326-fb0a-4e69-a0b3-6e30f0ee4eea {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:51 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6714628-2175-4460-bd26-f1ed037b3657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94230d52-ed80-4a9a-b62c-e7693faa3601', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:52 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea 1073741824 Sep 11 13:57:52 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4537c5d-66a4-4cb9-8122-43098a341c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:52 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Volume volume-94230d52-ed80-4a9a-b62c-e7693faa3601 (94230d52-ed80-4a9a-b62c-e7693faa3601): created successfully Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4537c5d-66a4-4cb9-8122-43098a341c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (073ca125-16a8-4fa8-8a7c-25a875f2cb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:52 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3f432c8c-7215-49b1-b2bb-eac0857ed5f2 tempest-CreateVolumesFromImageTest-77336000 None] Created volume successfully. Sep 11 13:57:52 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea 1073741824" returned: 0 in 0.440s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:52 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea Sep 11 13:57:52 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:52 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2030767527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4094e3a184645f88fd1e2c9fdc5eddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:50Z,use_quota=True,user_id='4e8069b867c64b9ebcab528a8f4df4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cc659ae-848a-4bea-9c82-f8464ae450d9),volume_type_id=4cc659ae-848a-4bea-9c82-f8464ae450d9)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Creating volume 2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:52 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396075c0-b1a2-4217-9542-bf0611a2e87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:52 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 1073741824 Sep 11 13:57:52 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f0fc4-6f0a-4d63-891c-c3de276b2302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:52 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Volume volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea (7de54326-fb0a-4e69-a0b3-6e30f0ee4eea): created successfully Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f0fc4-6f0a-4d63-891c-c3de276b2302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Flow 'volume_create_manager' (df6ed188-a974-4b9f-b05c-1c0dbf9661a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:52 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f9fc4707-4ca3-4395-9316-d9b55fb4f86e tempest-CreateVolumesFromImageTest-77336000 None] Created volume successfully. Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-quobyte-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7322a0-bd8e-4856-a43d-5614d37a36dc]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:53 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea Sep 11 13:57:53 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:53 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 1073741824" returned: 0 in 0.582s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:53 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 Sep 11 13:57:53 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:53 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea" returned: 0 in 0.432s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:53 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea Sep 11 13:57:53 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:53 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002226948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3454e6-972c-4b5f-8186-1e9cf7bd55ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:51Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Creating volume dd3454e6-972c-4b5f-8186-1e9cf7bd55ae {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:53 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:53 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae 1073741824 Sep 11 13:57:53 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28548b9-6f77-4260-903f-7b1c3f3fa7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d211275-54ff-4e64-bca9-2d62be804231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Volume volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 (2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8): created successfully Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d211275-54ff-4e64-bca9-2d62be804231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Flow 'volume_create_manager' (ee8aafcc-41d4-4f13-8c1a-89df69d05981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d7f94f54-7265-4ac1-a71b-c704b4784f69 tempest-VolumeTypesAccessTest-1154285861 None] Created volume successfully. Sep 11 13:57:53 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea" returned: 0 in 0.294s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea" released by "delete_volume" :: held 0.772s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:53 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Created reservations ['0e9be1a2-7c4c-4df2-8d3b-a011b8f366dc', '7a2dfc16-0ec4-43a2-8436-be6601e5f6d5', '644ee533-0012-4e02-afc9-5a55d40bd099', '9704c7f5-e39c-4de2-affb-76362ff00e8d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:54 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:54 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:54 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-94230d52-ed80-4a9a-b62c-e7693faa3601-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae 1073741824" returned: 0 in 0.548s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-94230d52-ed80-4a9a-b62c-e7693faa3601-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:54 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae Sep 11 13:57:54 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-quobyte-94230d52-ed80-4a9a-b62c-e7693faa3601" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-94230d52-ed80-4a9a-b62c-e7693faa3601" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:54 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.345s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3e8efa-3048-4c7b-a70d-59dd57b7681f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Deleted volume successfully. Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-557bf523-313f-4a2a-bce6-5d04b8dbe605 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-7de54326-fb0a-4e69-a0b3-6e30f0ee4eea-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:54 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 Sep 11 13:57:54 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:54 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae" returned: 0 in 0.350s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad37d7a-c36d-49e7-b997-863cd68d9dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd83379-9865-4e1b-9dc4-8ea4d02a00a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Volume volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae (dd3454e6-972c-4b5f-8186-1e9cf7bd55ae): created successfully Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd83379-9865-4e1b-9dc4-8ea4d02a00a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (8267437b-ca1a-45f9-8396-62818fc2412f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Acquiring lock "cinder-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4af1ce6b-ce9f-495b-9a07-725d07ad4ca2 tempest-VolumesActionsTest-401931930 None] Created volume successfully. Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Lock "cinder-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Acquiring lock "cinder-quobyte-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Lock "cinder-quobyte-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0629197-ef67-4634-a0ad-9d1866244143]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:54 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601" returned: 0 in 0.482s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:54 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601 Sep 11 13:57:54 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:54 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 Sep 11 13:57:54 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:55 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94230d52-ed80-4a9a-b62c-e7693faa3601" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-94230d52-ed80-4a9a-b62c-e7693faa3601" released by "delete_volume" :: held 0.833s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:55 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8" returned: 0 in 0.383s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:55 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8 Sep 11 13:57:55 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Created reservations ['1511ea95-8ff5-41a0-8a26-b0540d3ddd1f', 'a09cb3b1-e75b-4758-b781-2edb4ff50719', 'b361459f-a97f-4842-955b-8a0bb6085063', '0a565e05-0792-4670-a4e9-9d8a0a3f0837'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:55 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:55 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-31157443-c97b-484b-bfcd-8e73832fa998-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-31157443-c97b-484b-bfcd-8e73832fa998-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:55 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8" returned: 0 in 0.308s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Lock "cinder-quobyte-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8" released by "delete_volume" :: held 0.757s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-quobyte-31157443-c97b-484b-bfcd-8e73832fa998" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-31157443-c97b-484b-bfcd-8e73832fa998" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:55 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.315s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:55 devstack cinder-volume[88731]: WARNING cinder.quota [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1310023626 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1310023626, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:57:55 devstack cinder-volume[88731]: WARNING cinder.quota [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1310023626 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1310023626, it is now deprecated. Please use the default quota class for default quota. Sep 11 13:57:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Deleted volume successfully. Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc4ec88-f154-4f45-90f1-74c9ce94b2c3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Created reservations ['eec94cb8-0540-4198-9e7c-cb9261c0f5ed', '5b09d5fc-e27a-4678-99f1-0f6a7c924c20', 'e47cd927-173d-4940-b693-b158438c36b8', '62872c70-82f5-45b6-abd9-c3d973fddd5e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1c63d55b-769a-4e20-9d14-283344c4fbce tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-94230d52-ed80-4a9a-b62c-e7693faa3601-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:55 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 Sep 11 13:57:55 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:55 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:55 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Lock "cinder-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Acquiring lock "cinder-quobyte-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae" acquired by "delete_volume" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[855e9c9c-5b3d-45a5-981b-98a92ebdc72a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:56 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.299s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Deleted volume successfully. Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f482fa9-dffd-481a-b2d5-907f96c5d520 tempest-VolumeTypesAccessTest-1154285861 None] Lock "cinder-2e3f701b-ff9c-42c2-b7e1-a92bdbd752e8-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:56 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998" returned: 0 in 0.530s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:56 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae Sep 11 13:57:56 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:56 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998 Sep 11 13:57:56 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:56 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:56 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae Sep 11 13:57:56 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:56 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-31157443-c97b-484b-bfcd-8e73832fa998" returned: 0 in 0.358s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-31157443-c97b-484b-bfcd-8e73832fa998" released by "delete_volume" :: held 0.975s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Created reservations ['402c1873-3b53-4861-9dfb-33c78742bb3c', 'b0c2c428-53b5-4e17-9db2-1673a8162be4', '364c82a0-4553-479b-89df-936a2ea0cc59', '724cdca5-c56b-4bf2-81c0-b04787448e3a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Flow 'volume_create_manager' (4c41ceb6-5427-4bc4-9c13-ec9120a2cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d950751e-1266-4aac-8475-d2aa5caf3546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d950751e-1266-4aac-8475-d2aa5caf3546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1549912679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c11688-63ae-4e24-9de9-075a61f836ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc7e40157c845879d67b3c2e240b4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:57Z,use_quota=True,user_id='4d2732e0040e40129caf79b1fd71aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658500ae-9920-450c-b2be-bb4cf4387399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658500ae-9920-450c-b2be-bb4cf4387399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e707a31-0f2c-466c-a3b1-bb5acae4d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:56 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:56 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:56 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae" returned: 0 in 0.380s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Lock "cinder-quobyte-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae" released by "delete_volume" :: held 0.968s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:56 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Created reservations ['2e53c9b1-25bc-4c52-a05d-e7c5050afb19', '776ad609-1a68-4a1f-9258-748aac71f202', '54e2354f-cb79-4eeb-81f2-73793d3de785', 'bb26ac6a-3f20-43c9-bb26-2ed83a82ee21'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:57 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:57 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e707a31-0f2c-466c-a3b1-bb5acae4d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0c11688-63ae-4e24-9de9-075a61f836ab', 'volume_name': 'volume-f0c11688-63ae-4e24-9de9-075a61f836ab', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:57 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b84fb5-f5b7-40a2-966b-3ba9ec9cb541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b84fb5-f5b7-40a2-966b-3ba9ec9cb541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed5850d-36e8-4c1e-8e6c-3c7177709d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Volume f0c11688-63ae-4e24-9de9-075a61f836ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0c11688-63ae-4e24-9de9-075a61f836ab', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Trying to clone f0c11688-63ae-4e24-9de9-075a61f836ab from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Deleted volume successfully. Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-60e39de9-188c-4a82-b528-3884de0fc31f tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-31157443-c97b-484b-bfcd-8e73832fa998-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:57 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Deleted volume successfully. Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ed431a9e-c1cb-4396-9040-943830293a6a tempest-VolumesActionsTest-1844717591 None] Lock "cinder-dd3454e6-972c-4b5f-8186-1e9cf7bd55ae-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 13:57:57 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Image download 20.69 MB at 20.69 MB/s Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcfa378-34d1-42bc-a5ab-a9ad095025f3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:57 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD Sep 11 13:57:57 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-19d3acce-c121-49ad-9f4b-d28a4f65b83c-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (dd9b4c3b-dcd9-49db-a2d4-33d3e7220937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897efd44-6f22-48c4-8799-90ca8cec5029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-19d3acce-c121-49ad-9f4b-d28a4f65b83c-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897efd44-6f22-48c4-8799-90ca8cec5029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-44860517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40917e2d-d911-435d-828f-5f2fb599e688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:58Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5cf378-582c-4f63-adfa-e86aa99dff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5cf378-582c-4f63-adfa-e86aa99dff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee829b6-b7a2-4165-b1b0-aad80408ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee829b6-b7a2-4165-b1b0-aad80408ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40917e2d-d911-435d-828f-5f2fb599e688', 'volume_name': 'volume-40917e2d-d911-435d-828f-5f2fb599e688', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63c8dff-2510-40e6-8937-ccc6f5b0f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63c8dff-2510-40e6-8937-ccc6f5b0f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f85714-00f1-4f85-b350-da03bd027b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:57 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Volume 40917e2d-d911-435d-828f-5f2fb599e688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40917e2d-d911-435d-828f-5f2fb599e688', 'volume_size': 1} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-44860517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40917e2d-d911-435d-828f-5f2fb599e688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3ca8261a89465c8923f7a9fbb327cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:58Z,use_quota=True,user_id='2434748093314ce5a2cc85beea94a293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Creating volume 40917e2d-d911-435d-828f-5f2fb599e688 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:58 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:58 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 1073741824 Sep 11 13:57:58 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-quobyte-19d3acce-c121-49ad-9f4b-d28a4f65b83c" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-19d3acce-c121-49ad-9f4b-d28a4f65b83c" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807f5f7-bcbc-4746-8076-20234cc97bc3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:58 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c is fetched for user 4d2732e0040e40129caf79b1fd71aa49. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2926c27-f68f-4870-bb64-e3e9b1445057]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:58 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c Sep 11 13:57:58 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:58 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD Sep 11 13:57:58 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:58 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 1073741824" returned: 0 in 0.498s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:58 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c" returned: 0 in 0.471s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:58 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 Sep 11 13:57:58 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:58 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c Sep 11 13:57:58 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:58 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:58 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688" returned: 0 in 0.289s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1549912679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c11688-63ae-4e24-9de9-075a61f836ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc7e40157c845879d67b3c2e240b4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:57:57Z,use_quota=True,user_id='4d2732e0040e40129caf79b1fd71aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Creating volume f0c11688-63ae-4e24-9de9-075a61f836ab {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:57:58 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:58 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19d3acce-c121-49ad-9f4b-d28a4f65b83c" returned: 0 in 0.294s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:58 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab 1073741824 Sep 11 13:57:58 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f85714-00f1-4f85-b350-da03bd027b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40917e2d-d911-435d-828f-5f2fb599e688', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f74aa4-1bd3-43a0-8539-664cbb438c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-19d3acce-c121-49ad-9f4b-d28a4f65b83c" released by "delete_volume" :: held 0.827s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:58 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Volume volume-40917e2d-d911-435d-828f-5f2fb599e688 (40917e2d-d911-435d-828f-5f2fb599e688): created successfully Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f74aa4-1bd3-43a0-8539-664cbb438c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:57:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Flow 'volume_create_manager' (dd9b4c3b-dcd9-49db-a2d4-33d3e7220937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:57:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-792db156-9ab1-4049-ba70-a98af7398fff tempest-VolumesActionsTest-401931930 None] Created volume successfully. Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Created reservations ['7fc409e9-1804-4d04-9642-dbb5ccd307ae', 'b09ce087-a4b0-4270-ba29-69510e5e78ee', '00f2509e-3607-4800-b346-c9da319a37c7', '0f695c57-1e5f-41af-b02d-ab87c75578fa'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:59 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:57:59 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:59 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab 1073741824" returned: 0 in 0.483s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:59 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.282s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:57:59 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Deleted volume successfully. Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e514dfa-6ae7-40b2-a46c-9afbbe139978 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-19d3acce-c121-49ad-9f4b-d28a4f65b83c-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:57:59 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab Sep 11 13:57:59 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:57:59 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab" returned: 0 in 0.254s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Attempting download of 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume f0c11688-63ae-4e24-9de9-075a61f836ab. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3199297-0f5a-451e-89e2-7c74badb9934]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:57:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:57:59 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z Sep 11 13:57:59 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:00 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z" returned: 0 in 0.360s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-08b853ad-5999-49ce-9bde-0202f6a6c363-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-08b853ad-5999-49ce-9bde-0202f6a6c363-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:00 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z Sep 11 13:58:00 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "cinder-quobyte-08b853ad-5999-49ce-9bde-0202f6a6c363" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-08b853ad-5999-49ce-9bde-0202f6a6c363" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6235302-68ef-4f11-8114-2444ba495377]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:00 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 Sep 11 13:58:00 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:00 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z" returned: 1 in 0.390s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c__rzl1m9z' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc68b7-eed1-4ed9-85d9-8c0a22e1b9ce]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:00 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD Sep 11 13:58:00 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Acquiring lock "cinder-40917e2d-d911-435d-828f-5f2fb599e688-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Lock "cinder-40917e2d-d911-435d-828f-5f2fb599e688-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Acquiring lock "cinder-quobyte-40917e2d-d911-435d-828f-5f2fb599e688" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Lock "cinder-quobyte-40917e2d-d911-435d-828f-5f2fb599e688" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b55a12-0d0e-4870-b7d8-6737645a144c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:00 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:00 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363 Sep 11 13:58:00 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:00 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 Sep 11 13:58:00 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:01 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] 6b854647-c6a5-4221-a6fc-d6c3dbc5707c was qcow2, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:01 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab Sep 11 13:58:01 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:01 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-08b853ad-5999-49ce-9bde-0202f6a6c363" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-quobyte-08b853ad-5999-49ce-9bde-0202f6a6c363" released by "delete_volume" :: held 0.855s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:01 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688" returned: 0 in 0.425s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:01 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688 Sep 11 13:58:01 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Created reservations ['88651837-3633-4179-980d-48c4f9b3a886', '6cb9aae0-45e0-4220-94a3-d91e688d45c0', 'f928bdc1-053a-4852-bdd4-134711f9ffda', '8fcc826f-1c42-4305-b95e-8753edd60551'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:01 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:01 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:01 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-40917e2d-d911-435d-828f-5f2fb599e688" returned: 0 in 0.341s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Lock "cinder-quobyte-40917e2d-d911-435d-828f-5f2fb599e688" released by "delete_volume" :: held 0.826s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Created reservations ['d59c0fb5-9a49-4752-b71a-5ca3caf39bc4', 'de61125d-13a4-4ad1-a113-6602077ec934', 'acdc7136-d958-4c1d-9aa1-b6cfef3ba1e9', '39d60fb9-c16a-4b5a-9843-c154a4679c9b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:01 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.396s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Deleted volume successfully. Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a6d197a1-7916-4db3-9b5a-2500133f4409 tempest-CreateVolumesFromImageTest-77336000 None] Lock "cinder-08b853ad-5999-49ce-9bde-0202f6a6c363-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:01 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:01 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:02 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.442s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:02 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Deleted volume successfully. Sep 11 13:58:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b42e8e73-3f0e-43c0-9327-e93f0ae7f2e0 tempest-VolumesActionsTest-401931930 None] Lock "cinder-40917e2d-d911-435d-828f-5f2fb599e688-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:03 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab" returned: 0 in 2.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ge1qeev5devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:58:03 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Converted 112.00 MB image at 46.28 MB/s Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:03 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab 1G Sep 11 13:58:03 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:03 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab 1G" returned: 0 in 0.506s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Downloaded image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume f0c11688-63ae-4e24-9de9-075a61f836ab successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c for user 4d2732e0040e40129caf79b1fd71aa49 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Marking volume f0c11688-63ae-4e24-9de9-075a61f836ab as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Copying metadata from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c to f0c11688-63ae-4e24-9de9-075a61f836ab. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 13:58:03 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Creating volume glance metadata for volume f0c11688-63ae-4e24-9de9-075a61f836ab backed by image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 13:58:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed5850d-36e8-4c1e-8e6c-3c7177709d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c11688-63ae-4e24-9de9-075a61f836ab', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c1a817-72c7-41db-869b-d79d562276d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Volume volume-f0c11688-63ae-4e24-9de9-075a61f836ab (f0c11688-63ae-4e24-9de9-075a61f836ab): created successfully Sep 11 13:58:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c1a817-72c7-41db-869b-d79d562276d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Flow 'volume_create_manager' (4c41ceb6-5427-4bc4-9c13-ec9120a2cf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-21f60071-0103-4c84-9283-76194cf112b2 tempest-VolumesImageMetadata-1222421286 None] Created volume successfully. Sep 11 13:58:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Acquiring lock "cinder-f0c11688-63ae-4e24-9de9-075a61f836ab-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Lock "cinder-f0c11688-63ae-4e24-9de9-075a61f836ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Acquiring lock "cinder-quobyte-f0c11688-63ae-4e24-9de9-075a61f836ab" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Lock "cinder-quobyte-f0c11688-63ae-4e24-9de9-075a61f836ab" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7686bc70-d2d3-48fa-aacb-4c967e1218f9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:06 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab Sep 11 13:58:06 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:06 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab" returned: 0 in 0.425s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:06 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab Sep 11 13:58:06 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:06 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0c11688-63ae-4e24-9de9-075a61f836ab" returned: 0 in 0.328s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Lock "cinder-quobyte-f0c11688-63ae-4e24-9de9-075a61f836ab" released by "delete_volume" :: held 0.814s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:06 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Created reservations ['100501c7-8f49-4135-8344-edde456faf0b', '5b784de9-7f52-4897-ae37-7d200d67e408', 'e96995cb-c646-4e65-b94b-a1113366176d', 'c7e8bb24-66da-49aa-ae9e-c5a91fddf9f6'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:07 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:07 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:07 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.350s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Deleted volume successfully. Sep 11 13:58:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0a2ca93e-6746-456b-a7c3-0fb0ad305aff tempest-VolumesImageMetadata-1222421286 None] Lock "cinder-f0c11688-63ae-4e24-9de9-075a61f836ab-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Flow 'volume_create_manager' (d43815ec-224c-4bc6-94f6-3376fbd2ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8114d86-842f-453a-b4a7-c836a21123a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8114d86-842f-453a-b4a7-c836a21123a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc981feb-3803-4dba-9b49-1a59a31c39fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7c38dda51e49b3959cff1a74917864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:09Z,use_quota=True,user_id='b0a1033316654f7eaced1108c7e04b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd73ce05-666d-46ed-9539-4051cb129b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd73ce05-666d-46ed-9539-4051cb129b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26f6b29-322e-4cea-ad2b-4228c1876fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:08 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26f6b29-322e-4cea-ad2b-4228c1876fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc981feb-3803-4dba-9b49-1a59a31c39fe', 'volume_name': 'volume-cc981feb-3803-4dba-9b49-1a59a31c39fe', 'volume_size': 1, 'image_id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd62e86f5d1374dbd2eecb8ab42e78ee2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b7c38dda51e49b3959cff1a74917864', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'faee7642917c63bcd5d80becb850bbec4c60e61abcaa1116964cf603e445a1dda94ab14976f553769a4e14fbc94525b05620c7183bf3268a9bb227ecfa8ae5f0', 'id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'created_at': datetime.datetime(2026, 9, 11, 11, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 58, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b/file', 'properties': {}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ff5a7d-eb10-491a-8011-8d805f9d7fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ff5a7d-eb10-491a-8011-8d805f9d7fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf629d42-b4fa-4b87-a93e-bbedc625518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:09 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Volume cc981feb-3803-4dba-9b49-1a59a31c39fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc981feb-3803-4dba-9b49-1a59a31c39fe', 'volume_size': 1, 'image_id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd62e86f5d1374dbd2eecb8ab42e78ee2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b7c38dda51e49b3959cff1a74917864', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'faee7642917c63bcd5d80becb850bbec4c60e61abcaa1116964cf603e445a1dda94ab14976f553769a4e14fbc94525b05620c7183bf3268a9bb227ecfa8ae5f0', 'id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'created_at': datetime.datetime(2026, 9, 11, 11, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 58, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b/file', 'properties': {}}, 'image_service': } Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Trying to clone cc981feb-3803-4dba-9b49-1a59a31c39fe from image b60e5a5c-e62f-4441-a14e-c93e8adb425b at location (None, [{'url': 'file:///opt/stack/data/glance/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 13:58:09 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Image download 0.00 MB at 0.00 MB/s Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[675a112f-b0a3-44ff-bb95-d33c2a301a16]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:09 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD Sep 11 13:58:09 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:09 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:09 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD Sep 11 13:58:09 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:10 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Temporary image b60e5a5c-e62f-4441-a14e-c93e8adb425b is fetched for user b0a1033316654f7eaced1108c7e04b97. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5820e63-eef1-4e06-943a-4f2573ada5b8]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:10 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD Sep 11 13:58:10 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:10 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:10 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:10 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:10 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD Sep 11 13:58:10 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:10 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:58:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:58:11 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc981feb-3803-4dba-9b49-1a59a31c39fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7c38dda51e49b3959cff1a74917864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:09Z,use_quota=True,user_id='b0a1033316654f7eaced1108c7e04b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Creating volume cc981feb-3803-4dba-9b49-1a59a31c39fe {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:11 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:11 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe 1073741824 Sep 11 13:58:11 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:11 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe 1073741824" returned: 0 in 0.636s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:11 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe Sep 11 13:58:11 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:12 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Attempting download of b60e5a5c-e62f-4441-a14e-c93e8adb425b ((None, [{'url': 'file:///opt/stack/data/glance/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'metadata': {}}])) to volume cc981feb-3803-4dba-9b49-1a59a31c39fe. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[27817edd-c74e-46b9-a76e-e9fec07a038c]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:12 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u Sep 11 13:58:12 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:12 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u" returned: 0 in 0.482s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:12 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u Sep 11 13:58:12 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:13 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u" returned: 1 in 0.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b60e5a5c-e62f-4441-a14e-c93e8adb425b_lkaegm0u' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5683a142-d795-4f3e-9dba-b3e6f560bf02]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:13 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD Sep 11 13:58:13 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:13 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:13 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD Sep 11 13:58:13 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:13 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] b60e5a5c-e62f-4441-a14e-c93e8adb425b was raw, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 13:58:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:13 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe Sep 11 13:58:13 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:14 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe" returned: 0 in 0.695s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:14 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b60e5a5c-e62f-4441-a14e-c93e8adb425b_3r2iwokydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:58:14 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 13:58:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:14 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe 1G Sep 11 13:58:14 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Flow 'volume_create_manager' (79fb29f6-c0e7-4e7f-b26a-56628f02282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:15 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c756ba9-9fb6-4fe7-890f-71151f428f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe 1G" returned: 0 in 0.438s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Downloaded image b60e5a5c-e62f-4441-a14e-c93e8adb425b ((None, [{'url': 'file:///opt/stack/data/glance/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'metadata': {}}])) to volume cc981feb-3803-4dba-9b49-1a59a31c39fe successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Temporary image b60e5a5c-e62f-4441-a14e-c93e8adb425b for user b0a1033316654f7eaced1108c7e04b97 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Marking volume cc981feb-3803-4dba-9b49-1a59a31c39fe as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c756ba9-9fb6-4fe7-890f-71151f428f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-57265617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cd3378-5b29-48de-a999-c625519a5014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b918bd3c54b49ebb6fdcd1abc435f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:15Z,use_quota=True,user_id='2da8b51942784e8791005c59c75de3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1feb70e-1c50-4f4b-9b06-cf904c8edb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1feb70e-1c50-4f4b-9b06-cf904c8edb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1883c49f-8750-41eb-8c02-41ca3f752f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1883c49f-8750-41eb-8c02-41ca3f752f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cd3378-5b29-48de-a999-c625519a5014', 'volume_name': 'volume-19cd3378-5b29-48de-a999-c625519a5014', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecc6d8d-5460-4a44-973f-b36255c83867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecc6d8d-5460-4a44-973f-b36255c83867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7093eac7-901f-40f1-8273-ae7dad157c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:15 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Volume 19cd3378-5b29-48de-a999-c625519a5014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cd3378-5b29-48de-a999-c625519a5014', 'volume_size': 1} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-57265617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cd3378-5b29-48de-a999-c625519a5014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b918bd3c54b49ebb6fdcd1abc435f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:15Z,use_quota=True,user_id='2da8b51942784e8791005c59c75de3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Creating volume 19cd3378-5b29-48de-a999-c625519a5014 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:15 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Copying metadata from image b60e5a5c-e62f-4441-a14e-c93e8adb425b to cc981feb-3803-4dba-9b49-1a59a31c39fe. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Creating volume glance metadata for volume cc981feb-3803-4dba-9b49-1a59a31c39fe backed by image b60e5a5c-e62f-4441-a14e-c93e8adb425b with: {'image_id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd62e86f5d1374dbd2eecb8ab42e78ee2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 13:58:15 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 1073741824 Sep 11 13:58:15 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf629d42-b4fa-4b87-a93e-bbedc625518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc981feb-3803-4dba-9b49-1a59a31c39fe', 'volume_size': 1, 'image_id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd62e86f5d1374dbd2eecb8ab42e78ee2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b7c38dda51e49b3959cff1a74917864', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'faee7642917c63bcd5d80becb850bbec4c60e61abcaa1116964cf603e445a1dda94ab14976f553769a4e14fbc94525b05620c7183bf3268a9bb227ecfa8ae5f0', 'id': 'b60e5a5c-e62f-4441-a14e-c93e8adb425b', 'created_at': datetime.datetime(2026, 9, 11, 11, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 58, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b60e5a5c-e62f-4441-a14e-c93e8adb425b/file', 'properties': {}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a324ad6-d774-46f3-8bd0-8afab06086d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:15 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Volume volume-cc981feb-3803-4dba-9b49-1a59a31c39fe (cc981feb-3803-4dba-9b49-1a59a31c39fe): created successfully Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a324ad6-d774-46f3-8bd0-8afab06086d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Flow 'volume_create_manager' (d43815ec-224c-4bc6-94f6-3376fbd2ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e7722c52-14da-4d06-a828-7e62b6c77890 tempest-VolumeImageDependencyTests-40035334 None] Created volume successfully. Sep 11 13:58:15 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 1073741824" returned: 0 in 0.498s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:15 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 Sep 11 13:58:15 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:15 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7093eac7-901f-40f1-8273-ae7dad157c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cd3378-5b29-48de-a999-c625519a5014', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8018a08-ce73-4f4a-a66f-7a1a5cdf7f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:16 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Volume volume-19cd3378-5b29-48de-a999-c625519a5014 (19cd3378-5b29-48de-a999-c625519a5014): created successfully Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8018a08-ce73-4f4a-a66f-7a1a5cdf7f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Flow 'volume_create_manager' (79fb29f6-c0e7-4e7f-b26a-56628f02282a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6772e5cb-c9bb-4459-af65-19940351a113 tempest-AbsoluteLimitsTests-4735343 None] Created volume successfully. Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Acquiring lock "cinder-cc981feb-3803-4dba-9b49-1a59a31c39fe-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Lock "cinder-cc981feb-3803-4dba-9b49-1a59a31c39fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Acquiring lock "cinder-quobyte-cc981feb-3803-4dba-9b49-1a59a31c39fe" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Lock "cinder-quobyte-cc981feb-3803-4dba-9b49-1a59a31c39fe" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea0a1e-5b90-470a-b8be-260fa504f8a8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:16 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe Sep 11 13:58:16 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:16 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe" returned: 0 in 0.407s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:16 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe Sep 11 13:58:16 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:17 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-cc981feb-3803-4dba-9b49-1a59a31c39fe" returned: 0 in 0.298s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Lock "cinder-quobyte-cc981feb-3803-4dba-9b49-1a59a31c39fe" released by "delete_volume" :: held 0.749s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Created reservations ['f3a518dc-994f-465e-80d5-f1c49a7f7b8f', '70988436-384f-4489-8cb4-5120bb34ce63', '83082aaf-aab1-41e3-a98a-eefbbc28ee86', 'a34f0ff8-29c4-47cd-b6bc-b25006179420'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Acquiring lock "cinder-19cd3378-5b29-48de-a999-c625519a5014-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:17 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:17 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Lock "cinder-19cd3378-5b29-48de-a999-c625519a5014-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Acquiring lock "cinder-quobyte-19cd3378-5b29-48de-a999-c625519a5014" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Lock "cinder-quobyte-19cd3378-5b29-48de-a999-c625519a5014" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Flow 'volume_create_manager' (4887354b-088a-420d-8419-4dbc086eac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02133bff-fa92-4528-a421-88ab19c422ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66eacf-73f7-4815-9fc8-16db18a8a410]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02133bff-fa92-4528-a421-88ab19c422ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1059730585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f908b1-3bd0-4497-a03c-403014c03a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b14b565a5748e8a4d8fb7f100eb539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:18Z,use_quota=True,user_id='1b33def7e68e40e38ef52522e03e4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543b447e-37aa-4746-8f3c-fc03d23f0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543b447e-37aa-4746-8f3c-fc03d23f0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bc7f93-265b-46ce-8735-17d3c6a3acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bc7f93-265b-46ce-8735-17d3c6a3acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f908b1-3bd0-4497-a03c-403014c03a11', 'volume_name': 'volume-e0f908b1-3bd0-4497-a03c-403014c03a11', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98e19d6-78d6-4c30-9424-ab618cd7f530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98e19d6-78d6-4c30-9424-ab618cd7f530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f636bb-baf1-4b88-ad8e-126e5a97740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:17 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Volume e0f908b1-3bd0-4497-a03c-403014c03a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f908b1-3bd0-4497-a03c-403014c03a11', 'volume_size': 1} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1059730585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f908b1-3bd0-4497-a03c-403014c03a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b14b565a5748e8a4d8fb7f100eb539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:18Z,use_quota=True,user_id='1b33def7e68e40e38ef52522e03e4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Creating volume e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:17 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:17 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 Sep 11 13:58:17 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:17 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.378s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:17 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 1073741824 Sep 11 13:58:17 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Deleted volume successfully. Sep 11 13:58:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-90b453ef-bbc9-438c-a57d-8d84686bdf87 tempest-VolumeImageDependencyTests-40035334 None] Lock "cinder-cc981feb-3803-4dba-9b49-1a59a31c39fe-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:18 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014" returned: 0 in 0.448s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:18 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014 Sep 11 13:58:18 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:18 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 1073741824" returned: 0 in 0.519s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:18 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 Sep 11 13:58:18 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:18 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-19cd3378-5b29-48de-a999-c625519a5014" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Lock "cinder-quobyte-19cd3378-5b29-48de-a999-c625519a5014" released by "delete_volume" :: held 0.882s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Created reservations ['38a79aa3-1f39-485d-8ef4-7155e2b5c3df', '6e1fcc7b-e2dd-4d01-b422-96f7046155e7', '25778a8e-1d46-44cd-b57b-3c3aef043c3f', '248fab01-4ab4-4220-9bb8-73ace0d8a6ba'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:18 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:18 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11" returned: 0 in 0.327s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:18 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f636bb-baf1-4b88-ad8e-126e5a97740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f908b1-3bd0-4497-a03c-403014c03a11', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760fbe30-f655-4123-a50b-698551f271f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:18 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Volume volume-e0f908b1-3bd0-4497-a03c-403014c03a11 (e0f908b1-3bd0-4497-a03c-403014c03a11): created successfully Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760fbe30-f655-4123-a50b-698551f271f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Flow 'volume_create_manager' (4887354b-088a-420d-8419-4dbc086eac07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6fb4eab8-a3f0-4c82-bdee-26e5c8db6ed6 tempest-VolumesDeleteCascade-1890603095 None] Created volume successfully. Sep 11 13:58:19 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.417s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:19 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Deleted volume successfully. Sep 11 13:58:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-292972ae-e837-4593-bcb7-b3041f296df2 tempest-AbsoluteLimitsTests-4735343 None] Lock "cinder-19cd3378-5b29-48de-a999-c625519a5014-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Creating offline snapshot d98f69a1-67cd-493d-bc7f-4b2926f787d8 of volume e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Flow 'volume_create_manager' (d18592fa-46f8-48ac-acf2-0fa3f20d6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050c4644-815c-41b3-aa5a-d5edd3da2cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486147f-32ae-4bf4-87d1-a508a37133ca]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050c4644-815c-41b3-aa5a-d5edd3da2cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-95489037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cea9c8-6c50-4685-86f8-54e90181df89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068f73edcd654cc3b927c8040662bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:20Z,use_quota=True,user_id='49ef53dfbf804a0c8facb9806bc5c10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247ac224-4a21-4437-a927-22322cd0dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247ac224-4a21-4437-a927-22322cd0dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1203f3-2e83-4a9f-9177-c675b33c94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1203f3-2e83-4a9f-9177-c675b33c94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5cea9c8-6c50-4685-86f8-54e90181df89', 'volume_name': 'volume-e5cea9c8-6c50-4685-86f8-54e90181df89', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a170fabd-76df-485c-b6ea-52008d0a172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a170fabd-76df-485c-b6ea-52008d0a172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65da0a7e-a9fc-46b2-bbfc-aec3f53f9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:20 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Volume e5cea9c8-6c50-4685-86f8-54e90181df89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5cea9c8-6c50-4685-86f8-54e90181df89', 'volume_size': 1} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:20 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 Sep 11 13:58:20 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:20 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:20 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 1G Sep 11 13:58:20 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:21 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 1G" returned: 0 in 0.577s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f908b1-3bd0-4497-a03c-403014c03a11 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:21 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f908b1-3bd0-4497-a03c-403014c03a11 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:21 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:21 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f908b1-3bd0-4497-a03c-403014c03a11 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:21 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 is being set with open permissions: ugo+rw Sep 11 13:58:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:21 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:21 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:21 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.274s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:21 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info Sep 11 13:58:21 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:22 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:22 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info is being set with open permissions: ugo+rw Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:22 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info Sep 11 13:58:22 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:22 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.info" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-95489037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cea9c8-6c50-4685-86f8-54e90181df89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068f73edcd654cc3b927c8040662bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:20Z,use_quota=True,user_id='49ef53dfbf804a0c8facb9806bc5c10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Creating volume e5cea9c8-6c50-4685-86f8-54e90181df89 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:22 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:22 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 1073741824 Sep 11 13:58:22 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4e293de7-4f1b-439b-973a-4d5b450b9ea4 tempest-VolumesDeleteCascade-1890603095 None] Create snapshot completed successfully Sep 11 13:58:23 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 1073741824" returned: 0 in 0.542s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:23 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 Sep 11 13:58:23 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:23 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89" returned: 0 in 0.392s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.086s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Creating offline snapshot 942bf751-6f62-4542-854e-2abe323477c5 of volume e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65da0a7e-a9fc-46b2-bbfc-aec3f53f9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5cea9c8-6c50-4685-86f8-54e90181df89', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28562e04-87e4-43af-85ae-a1932c11b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f78c3-6d15-464e-9cdc-b807e27fd410]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:23 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Volume volume-e5cea9c8-6c50-4685-86f8-54e90181df89 (e5cea9c8-6c50-4685-86f8-54e90181df89): created successfully Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28562e04-87e4-43af-85ae-a1932c11b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Flow 'volume_create_manager' (d18592fa-46f8-48ac-acf2-0fa3f20d6691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-269fda4e-3c2f-43be-b03a-4a98191b6ff7 tempest-VolumesTransfersV355Test-1862677589 None] Created volume successfully. Sep 11 13:58:23 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:23 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:23 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.443s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f908b1-3bd0-4497-a03c-403014c03a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:58:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:24 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 1G Sep 11 13:58:24 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:24 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 1G" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:24 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 Sep 11 13:58:24 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Flow 'volume_create_manager' (2ae12b5f-b39a-4e81-8e69-8e4071def2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6cb573-4b67-48cb-8c19-5e886af13dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6cb573-4b67-48cb-8c19-5e886af13dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-344830131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba90f8a-b73e-4c3b-8911-6c891568d282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae33020149634e1d947fb301ebf18ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:25Z,use_quota=True,user_id='1839326a41854b1eacbfff2c449dbf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac75ee35-bb17-43c1-bb4c-ab43279cf190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac75ee35-bb17-43c1-bb4c-ab43279cf190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a713c5-51df-4309-808a-d7e9d0279232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a713c5-51df-4309-808a-d7e9d0279232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba90f8a-b73e-4c3b-8911-6c891568d282', 'volume_name': 'volume-5ba90f8a-b73e-4c3b-8911-6c891568d282', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1250a79-10f1-4c18-808e-eb6d5a5f1711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1250a79-10f1-4c18-808e-eb6d5a5f1711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4932a2e-4819-4d4e-ae57-d0255b6993c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Volume 5ba90f8a-b73e-4c3b-8911-6c891568d282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba90f8a-b73e-4c3b-8911-6c891568d282', 'volume_size': 1} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:25 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:25 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 is being set with open permissions: ugo+rw Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:25 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 Sep 11 13:58:25 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:25 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5" returned: 0 in 0.261s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f5133f6c-188c-4767-a9e9-cf6464ea5650 tempest-VolumesTransfersV355Test-1233838326 None] Transfer volume completed successfully. Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-344830131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba90f8a-b73e-4c3b-8911-6c891568d282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae33020149634e1d947fb301ebf18ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:25Z,use_quota=True,user_id='1839326a41854b1eacbfff2c449dbf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Creating volume 5ba90f8a-b73e-4c3b-8911-6c891568d282 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:25 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:25 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 1073741824 Sep 11 13:58:25 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-61f5c9e5-c6c3-426b-a180-c86f57a3fc76 tempest-VolumesDeleteCascade-1890603095 None] Create snapshot completed successfully Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-e0f908b1-3bd0-4497-a03c-403014c03a11-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-e0f908b1-3bd0-4497-a03c-403014c03a11-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Performing cascade delete. {{(pid=88731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-942bf751-6f62-4542-854e-2abe323477c5-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-942bf751-6f62-4542-854e-2abe323477c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-942bf751-6f62-4542-854e-2abe323477c5" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:25 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-942bf751-6f62-4542-854e-2abe323477c5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Deleting offline snapshot 942bf751-6f62-4542-854e-2abe323477c5 of volume e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] snapshot_file for this snap is: volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 1073741824" returned: 0 in 0.667s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fb5a2a-ef93-4eea-a275-207398913873]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:26 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 Sep 11 13:58:26 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Acquiring lock "cinder-e5cea9c8-6c50-4685-86f8-54e90181df89-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:26 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 Sep 11 13:58:26 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-e5cea9c8-6c50-4685-86f8-54e90181df89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Acquiring lock "cinder-quobyte-e5cea9c8-6c50-4685-86f8-54e90181df89" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-quobyte-e5cea9c8-6c50-4685-86f8-54e90181df89" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77a77de-d0fe-4977-bcd4-a74e8580cfae]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:26 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 Sep 11 13:58:26 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:26 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:26 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5" returned: 0 in 0.416s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f908b1-3bd0-4497-a03c-403014c03a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4932a2e-4819-4d4e-ae57-d0255b6993c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba90f8a-b73e-4c3b-8911-6c891568d282', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56b84c3-43e0-44fd-bc19-c96502b12003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c0cde-f018-46e8-8c4d-9c6238a7c0c9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Volume volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 (5ba90f8a-b73e-4c3b-8911-6c891568d282): created successfully Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56b84c3-43e0-44fd-bc19-c96502b12003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Flow 'volume_create_manager' (2ae12b5f-b39a-4e81-8e69-8e4071def2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:26 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-01b4cac4-422f-45f7-89f6-c7f88e0d08ad tempest-VolumesMetadataTest-255431915 None] Created volume successfully. Sep 11 13:58:26 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:26 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:26 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89" returned: 0 in 0.416s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:26 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89 Sep 11 13:58:26 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:26 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.405s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f908b1-3bd0-4497-a03c-403014c03a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:26 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 Sep 11 13:58:26 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:26 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5cea9c8-6c50-4685-86f8-54e90181df89" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-quobyte-e5cea9c8-6c50-4685-86f8-54e90181df89" released by "delete_volume" :: held 0.749s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Created reservations ['fd1bab7f-3026-4062-9b15-6d3386d521a2', '99334aed-8cb4-442e-ab2d-a7398dc0e663', 'd4bd5f34-acd4-49c4-9c94-f8c9a2c649a2', '5663c3c7-e6ca-4716-8860-73fab958bba3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:27 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:27 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:27 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5" returned: 0 in 0.566s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:27 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.340s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Deleted volume successfully. Sep 11 13:58:27 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5 Sep 11 13:58:27 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d735e3bf-5ebe-414f-9b3b-0f0ac23c9203 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-e5cea9c8-6c50-4685-86f8-54e90181df89-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:27 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.942bf751-6f62-4542-854e-2abe323477c5" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-942bf751-6f62-4542-854e-2abe323477c5" released by "_delete_snapshot" :: held 1.928s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" released by "delete_snapshot" :: held 1.973s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Created reservations ['8c537286-4ca6-41bb-b015-5f236fa844ca', '5102be55-a461-4aaf-ba39-e7cc5591bee2', 'c0de41b3-1f82-433f-8336-1fd909168e1f', 'e997b9fc-0459-4782-b146-1636a68704bf'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Delete snapshot completed successfully. Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-942bf751-6f62-4542-854e-2abe323477c5-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-d98f69a1-67cd-493d-bc7f-4b2926f787d8-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-d98f69a1-67cd-493d-bc7f-4b2926f787d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-d98f69a1-67cd-493d-bc7f-4b2926f787d8" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-d98f69a1-67cd-493d-bc7f-4b2926f787d8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Deleting offline snapshot d98f69a1-67cd-493d-bc7f-4b2926f787d8 of volume e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] snapshot_file for this snap is: volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda6ac94-6e8e-44a5-b732-bae5943e70c1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:28 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:28 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Flow 'volume_create_manager' (35acad54-acd5-4081-ae96-5c83fcb085ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568af398-f5b1-4e9b-b737-1a209c104e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Acquiring lock "cinder-5ba90f8a-b73e-4c3b-8911-6c891568d282-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568af398-f5b1-4e9b-b737-1a209c104e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-266011789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3bcb4f-b392-4a39-ae04-42b5d5d2d353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068f73edcd654cc3b927c8040662bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:28Z,use_quota=True,user_id='49ef53dfbf804a0c8facb9806bc5c10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5e812d-4566-4bff-ada8-ce513185741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5e812d-4566-4bff-ada8-ce513185741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9822d2e-2acd-46b6-8bdc-6cc9e2a7c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9822d2e-2acd-46b6-8bdc-6cc9e2a7c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3bcb4f-b392-4a39-ae04-42b5d5d2d353', 'volume_name': 'volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5a0c6a-e32a-4283-bc8b-9d3f3e705ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5a0c6a-e32a-4283-bc8b-9d3f3e705ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8c1ef1-94f7-4864-9331-2e8428d8f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Volume 9e3bcb4f-b392-4a39-ae04-42b5d5d2d353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353', 'volume_size': 1} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-266011789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3bcb4f-b392-4a39-ae04-42b5d5d2d353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068f73edcd654cc3b927c8040662bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:28Z,use_quota=True,user_id='49ef53dfbf804a0c8facb9806bc5c10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Creating volume 9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:28 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Lock "cinder-5ba90f8a-b73e-4c3b-8911-6c891568d282-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:28 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 1073741824 Sep 11 13:58:28 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Acquiring lock "cinder-quobyte-5ba90f8a-b73e-4c3b-8911-6c891568d282" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Lock "cinder-quobyte-5ba90f8a-b73e-4c3b-8911-6c891568d282" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c73f3-801e-422a-8655-677ef25a68d3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:28 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.561s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f908b1-3bd0-4497-a03c-403014c03a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:58:28 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 Sep 11 13:58:28 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d032bff8-9c01-4ec0-bc3d-f5adff0a48aa]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:29 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 Sep 11 13:58:29 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:29 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 1073741824" returned: 0 in 0.482s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:29 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:29 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282" returned: 0 in 0.430s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:29 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:29 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282 Sep 11 13:58:29 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:29 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11" returned: 0 in 0.487s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:29 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:29 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:29 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8c1ef1-94f7-4864-9331-2e8428d8f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da809816-2d24-4fca-9974-8f4e112d754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Volume volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 (9e3bcb4f-b392-4a39-ae04-42b5d5d2d353): created successfully Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da809816-2d24-4fca-9974-8f4e112d754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Flow 'volume_create_manager' (35acad54-acd5-4081-ae96-5c83fcb085ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-eaeab7a9-86af-49b7-ac1d-7a8072e44bb8 tempest-VolumesTransfersV355Test-1862677589 None] Created volume successfully. Sep 11 13:58:29 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5ba90f8a-b73e-4c3b-8911-6c891568d282" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Lock "cinder-quobyte-5ba90f8a-b73e-4c3b-8911-6c891568d282" released by "delete_volume" :: held 0.825s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Created reservations ['59f51cd8-713d-4f91-9c7e-827daf00bc37', 'd0d194b1-2006-45ae-816b-97cc0efabde1', 'e994bc2e-0f05-427a-b352-7e2c097dbd84', 'e6e2a17b-1203-498a-88bd-8564eb338a19'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:29 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:29 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:29 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.498s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:29 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8 Sep 11 13:58:29 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:30 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Deleted volume successfully. Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-623bb621-6a03-4cda-877f-721f18e76744 tempest-VolumesMetadataTest-255431915 None] Lock "cinder-5ba90f8a-b73e-4c3b-8911-6c891568d282-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:30 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11.d98f69a1-67cd-493d-bc7f-4b2926f787d8" returned: 0 in 0.288s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-d98f69a1-67cd-493d-bc7f-4b2926f787d8" released by "_delete_snapshot" :: held 2.000s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" released by "delete_snapshot" :: held 2.032s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Created reservations ['c822bca7-2c6c-41bd-b755-dfb77ae0bd2d', '05ffb4f9-858f-4351-8622-a6f67fc88a3c', 'ca98b050-85c5-4ae7-8c07-5cb17711f7de', '2bb865e3-7edb-479a-99a7-89c599e9a60f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Delete snapshot completed successfully. Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-d98f69a1-67cd-493d-bc7f-4b2926f787d8-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Snapshots deleted, issuing volume delete {{(pid=88731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b993cebb-c746-42ce-beb5-187acbb2cdab]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:30 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 Sep 11 13:58:30 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:30 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Acquiring lock "cinder-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11" returned: 0 in 0.462s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:30 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11 Sep 11 13:58:30 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Acquiring lock "cinder-quobyte-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-quobyte-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[67837d9f-d7db-4725-8eaa-16b9082daa72]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:31 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 Sep 11 13:58:31 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:31 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e0f908b1-3bd0-4497-a03c-403014c03a11" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e0f908b1-3bd0-4497-a03c-403014c03a11" released by "delete_volume" :: held 0.896s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Created reservations ['0e666b2e-b445-4170-8107-8fcfff403da0', 'da535ec5-94d4-47d1-9766-514c15873e8d', '045aa9ad-2bbf-4ff9-9576-2e970132c67c', '1b44bc44-c960-437b-b839-3d5ea5845a7e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:31 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:31 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:31 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353" returned: 0 in 0.546s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:31 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353 Sep 11 13:58:31 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:31 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.399s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Deleted volume successfully. Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-878c8b63-f094-42d2-ae5c-c176723f365d tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-e0f908b1-3bd0-4497-a03c-403014c03a11-delete_volume" released by "delete_volume" :: held 6.125s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:31 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353" returned: 0 in 0.341s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-quobyte-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353" released by "delete_volume" :: held 0.944s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Created reservations ['184dce6e-7e03-434e-9fa8-6ff806c93ec5', 'd30f59ff-051e-497c-90ea-0a521ca70f8c', '578b2ef0-bc94-4b3b-900b-be1a168c3079', '93048791-b96e-4d1d-b130-777507127238'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:32 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:32 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:32 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.267s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Deleted volume successfully. Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b75e87cd-44c0-4dec-bccb-d12e66a38706 tempest-VolumesTransfersV355Test-67981723 None] Lock "cinder-9e3bcb4f-b392-4a39-ae04-42b5d5d2d353-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Flow 'volume_create_manager' (fedf2906-cb77-4bc7-95c2-588920efb9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bd4642-acd1-4b7b-bcb5-86fd880265ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bd4642-acd1-4b7b-bcb5-86fd880265ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550209170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dad20e-6da8-4f28-9ddb-75c79f2ce0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b14b565a5748e8a4d8fb7f100eb539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:33Z,use_quota=True,user_id='1b33def7e68e40e38ef52522e03e4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f1ca82-c105-4be1-b910-7d401e650637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f1ca82-c105-4be1-b910-7d401e650637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa49c74-a767-488c-96ce-9f5503ffb6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa49c74-a767-488c-96ce-9f5503ffb6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7dad20e-6da8-4f28-9ddb-75c79f2ce0db', 'volume_name': 'volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35815bac-a6a4-49bb-a132-0307b038629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35815bac-a6a4-49bb-a132-0307b038629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4748bb-772b-48ef-902c-cef785e52928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Volume e7dad20e-6da8-4f28-9ddb-75c79f2ce0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db', 'volume_size': 1} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550209170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dad20e-6da8-4f28-9ddb-75c79f2ce0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b14b565a5748e8a4d8fb7f100eb539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:33Z,use_quota=True,user_id='1b33def7e68e40e38ef52522e03e4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Creating volume e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:33 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:33 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db 1073741824 Sep 11 13:58:33 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:33 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db 1073741824" returned: 0 in 0.588s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:33 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db Sep 11 13:58:33 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:34 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" returned: 0 in 0.462s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4748bb-772b-48ef-902c-cef785e52928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263c3b67-f36c-449d-b67e-6a222e56c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Volume volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db (e7dad20e-6da8-4f28-9ddb-75c79f2ce0db): created successfully Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263c3b67-f36c-449d-b67e-6a222e56c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Flow 'volume_create_manager' (fedf2906-cb77-4bc7-95c2-588920efb9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3264b98e-6512-4b33-bf66-25e49b8c9ced tempest-VolumesDeleteCascade-1890603095 None] Created volume successfully. Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Flow 'volume_create_manager' (0101be97-f97f-4997-8ba1-fcddd9cbcb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e11fc58-e31e-4bbc-a4e2-36f666fa1a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e11fc58-e31e-4bbc-a4e2-36f666fa1a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1681234918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafefc2b-a4a1-4055-92eb-f1f6e48a2990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e28ed1ab25473dadb82ebd3931a608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:35Z,use_quota=True,user_id='7d7a9cef0ef34125b7c4d8d3581332aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe23441-86e4-4aa7-b4df-7923eda1c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe23441-86e4-4aa7-b4df-7923eda1c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640d4b65-2e54-4ded-9c87-8eda3c5e91a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640d4b65-2e54-4ded-9c87-8eda3c5e91a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafefc2b-a4a1-4055-92eb-f1f6e48a2990', 'volume_name': 'volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990', 'volume_size': 2}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf0409a-4aa2-4ae7-9b6e-715d9d14bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf0409a-4aa2-4ae7-9b6e-715d9d14bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694a9ba1-9635-46a7-a2ff-e95c4e0b885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:35 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Volume dafefc2b-a4a1-4055-92eb-f1f6e48a2990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990', 'volume_size': 2} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1681234918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafefc2b-a4a1-4055-92eb-f1f6e48a2990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e28ed1ab25473dadb82ebd3931a608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:35Z,use_quota=True,user_id='7d7a9cef0ef34125b7c4d8d3581332aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Creating volume dafefc2b-a4a1-4055-92eb-f1f6e48a2990 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:35 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 2147483648 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:35 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 2147483648 Sep 11 13:58:35 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:35 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 2147483648" returned: 0 in 0.563s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:35 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 Sep 11 13:58:36 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:36 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.915s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Creating offline snapshot ae6943d5-bf48-4d6b-95ab-98fa0840ea4f of volume e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694a9ba1-9635-46a7-a2ff-e95c4e0b885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990', 'volume_size': 2}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a4f19b-9941-489b-a5c5-2d14b8f064c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc0690-e719-4728-a5a1-2698907b72ec]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:36 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Volume volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 (dafefc2b-a4a1-4055-92eb-f1f6e48a2990): created successfully Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a4f19b-9941-489b-a5c5-2d14b8f064c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Flow 'volume_create_manager' (0101be97-f97f-4997-8ba1-fcddd9cbcb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bb72e260-653e-4864-8469-14aac6b13966 tempest-VolumesCloneNegativeTest-54621272 None] Created volume successfully. Sep 11 13:58:36 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db Sep 11 13:58:36 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:36 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" returned: 0 in 0.447s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:36 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f 1G Sep 11 13:58:36 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:37 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f 1G" returned: 0 in 0.657s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Acquiring lock "cinder-dafefc2b-a4a1-4055-92eb-f1f6e48a2990-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:37 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f Sep 11 13:58:37 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Lock "cinder-dafefc2b-a4a1-4055-92eb-f1f6e48a2990-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Acquiring lock "cinder-quobyte-dafefc2b-a4a1-4055-92eb-f1f6e48a2990" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Lock "cinder-quobyte-dafefc2b-a4a1-4055-92eb-f1f6e48a2990" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a7655f-fea4-4937-bd3e-83222e26f59a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:37 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 Sep 11 13:58:37 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:37 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" returned: 0 in 0.389s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f is being set with open permissions: ugo+rw Sep 11 13:58:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:37 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f Sep 11 13:58:37 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:38 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" returned: 0 in 0.311s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:38 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info Sep 11 13:58:38 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:38 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990" returned: 0 in 0.630s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:38 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990 Sep 11 13:58:38 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:38 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dafefc2b-a4a1-4055-92eb-f1f6e48a2990" returned: 0 in 0.359s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Lock "cinder-quobyte-dafefc2b-a4a1-4055-92eb-f1f6e48a2990" released by "delete_volume" :: held 1.050s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:38 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info" returned: 0 in 0.490s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:38 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info is being set with open permissions: ugo+rw Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:38 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info Sep 11 13:58:38 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Created reservations ['bd3a3b73-6ed4-4d19-8d32-1692a342566e', 'c6de94fc-5875-4bc5-9c02-8c857c304000', '8bd8e14d-3448-4e74-9dfc-701abc6e2a85', '33854c90-fead-4ee7-a36d-38a3f3ffd077'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:38 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:38 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:39 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.info" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-46782880-1a8c-44d6-a30c-111b26e80e64 tempest-VolumesDeleteCascade-1890603095 None] Create snapshot completed successfully Sep 11 13:58:39 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.320s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:39 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Deleted volume successfully. Sep 11 13:58:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-23346c3c-fd02-43bd-8629-2b3796318834 tempest-VolumesCloneNegativeTest-54621272 None] Lock "cinder-dafefc2b-a4a1-4055-92eb-f1f6e48a2990-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Flow 'volume_create_manager' (e08e7519-3853-4f78-83fb-1793188b8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224fde7e-e696-4bf4-b6af-21ebdf726c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224fde7e-e696-4bf4-b6af-21ebdf726c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2061582066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690be63d-a8cf-47bc-b677-a3c0d2fea100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b14b565a5748e8a4d8fb7f100eb539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae6943d5-bf48-4d6b-95ab-98fa0840ea4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:40Z,use_quota=True,user_id='1b33def7e68e40e38ef52522e03e4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd0d89f-70dc-406f-a37f-93752499a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd0d89f-70dc-406f-a37f-93752499a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf4c47a-ef6e-4dfa-9bea-4bfe64a30e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf4c47a-ef6e-4dfa-9bea-4bfe64a30e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '690be63d-a8cf-47bc-b677-a3c0d2fea100', 'volume_name': 'volume-690be63d-a8cf-47bc-b677-a3c0d2fea100', 'volume_size': 1, 'snapshot_id': 'ae6943d5-bf48-4d6b-95ab-98fa0840ea4f'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493bd464-6eb8-48a5-aaf2-31e2e7cf689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493bd464-6eb8-48a5-aaf2-31e2e7cf689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134a61a9-388c-4faa-ae5a-2477a909b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:40 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Volume 690be63d-a8cf-47bc-b677-a3c0d2fea100: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-690be63d-a8cf-47bc-b677-a3c0d2fea100', 'volume_size': 1, 'snapshot_id': 'ae6943d5-bf48-4d6b-95ab-98fa0840ea4f'} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f-690be63d-a8cf-47bc-b677-a3c0d2fea100" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f-690be63d-a8cf-47bc-b677-a3c0d2fea100" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Creating volume 690be63d-a8cf-47bc-b677-a3c0d2fea100 from snapshot ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-690be63d-a8cf-47bc-b677-a3c0d2fea100" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-690be63d-a8cf-47bc-b677-a3c0d2fea100" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] snapshot: ae6943d5-bf48-4d6b-95ab-98fa0840ea4f, volume: 690be63d-a8cf-47bc-b677-a3c0d2fea100, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0988ea0d-a6b1-4590-b249-0855a50f339c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:40 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f Sep 11 13:58:40 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:40 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" returned: 0 in 0.506s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e85b85-52d2-4dcd-92ea-cfdc92580440]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:41 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db Sep 11 13:58:41 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:41 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" returned: 0 in 0.451s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:58:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:58:41 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:58:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:41 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 Sep 11 13:58:41 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:47 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100" returned: 0 in 5.921s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:58:47 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Converted 1024.00 MB image at 172.91 MB/s Sep 11 13:58:47 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 is being set with open permissions: ugo+rw Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:47 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 Sep 11 13:58:47 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:47 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100" returned: 0 in 0.301s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-690be63d-a8cf-47bc-b677-a3c0d2fea100" released by "_copy_volume_from_snapshot" :: held 7.280s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f-690be63d-a8cf-47bc-b677-a3c0d2fea100" released by "_create_volume_from_snapshot" :: held 7.372s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.394s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134a61a9-388c-4faa-ae5a-2477a909b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690be63d-a8cf-47bc-b677-a3c0d2fea100', 'volume_size': 1, 'snapshot_id': 'ae6943d5-bf48-4d6b-95ab-98fa0840ea4f'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696f49b9-7fd4-43f1-81ff-c44b8cc9d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:47 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Volume volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 (690be63d-a8cf-47bc-b677-a3c0d2fea100): created successfully Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696f49b9-7fd4-43f1-81ff-c44b8cc9d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Flow 'volume_create_manager' (e08e7519-3853-4f78-83fb-1793188b8adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:47 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1b86da92-cb7d-444c-9f01-803b309dafa6 tempest-VolumesDeleteCascade-1890603095 None] Created volume successfully. Sep 11 13:58:47 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Flow 'volume_create_manager' (844a5f29-b48e-47be-b316-dcba015e9313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f848f7-0705-448e-9ad8-ea6c72d57e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f848f7-0705-448e-9ad8-ea6c72d57e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1094198244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bbd14f-2258-4020-aa8a-76be3cbeb1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25edd300a2b34225a8ab94a0d5ebbc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:48Z,use_quota=True,user_id='de7900951449497c8b616244a7288724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10632755-d162-450b-be5c-3d935b69fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10632755-d162-450b-be5c-3d935b69fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe954417-11b1-4c7a-acf5-96f6c6ebf6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe954417-11b1-4c7a-acf5-96f6c6ebf6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bbd14f-2258-4020-aa8a-76be3cbeb1c2', 'volume_name': 'volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd86dca5-5705-4b1c-98e7-2021345b98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd86dca5-5705-4b1c-98e7-2021345b98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1265fc07-57c0-4b42-b64e-ab732599d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Volume b0bbd14f-2258-4020-aa8a-76be3cbeb1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2', 'volume_size': 1} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1094198244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0bbd14f-2258-4020-aa8a-76be3cbeb1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25edd300a2b34225a8ab94a0d5ebbc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:48Z,use_quota=True,user_id='de7900951449497c8b616244a7288724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Creating volume b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:48 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:48 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 1073741824 Sep 11 13:58:48 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Flow 'volume_create_manager' (4c772a29-2d7f-4ac3-881d-fd33bc8488c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9e05b7-0fe4-4599-91bd-40ccb4ce60e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9e05b7-0fe4-4599-91bd-40ccb4ce60e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1696939219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba50721-4072-4247-836f-b3f828101583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cab9d6a20a4d4d975a025b358977a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:48Z,use_quota=True,user_id='350742b7f5074f678f3d2642435b5081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebe4ea5-9ad9-40b3-acdc-ab3d5981bdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebe4ea5-9ad9-40b3-acdc-ab3d5981bdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceac5155-6c7d-4b62-b63e-a232f6bb3051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Performing cascade delete. {{(pid=88731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Deleting offline snapshot ae6943d5-bf48-4d6b-95ab-98fa0840ea4f of volume e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] snapshot_file for this snap is: volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b40b51-63d9-466b-ba64-3ad32448d236]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:48 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 1073741824" returned: 0 in 0.640s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:48 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f Sep 11 13:58:48 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:48 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 Sep 11 13:58:48 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceac5155-6c7d-4b62-b63e-a232f6bb3051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ba50721-4072-4247-836f-b3f828101583', 'volume_name': 'volume-1ba50721-4072-4247-836f-b3f828101583', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf349ab-fbc8-496d-ad29-1bb7bbe0944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf349ab-fbc8-496d-ad29-1bb7bbe0944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4416473-d942-4b69-b1e3-08b4cc941087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Volume 1ba50721-4072-4247-836f-b3f828101583: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ba50721-4072-4247-836f-b3f828101583', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 13:58:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Trying to clone 1ba50721-4072-4247-836f-b3f828101583 from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 13:58:49 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:49 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" returned: 0 in 0.596s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2" returned: 0 in 0.491s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:DELETE=21,cinder:UPDATE=207,cinder:SELECT=160,cinder:INSERT=52 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff3a497-6de7-4c21-b241-3234aeda4532]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1265fc07-57c0-4b42-b64e-ab732599d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8320368-c6df-4505-868a-7d6b61bea827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 13:58:49 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Image download 20.69 MB at 20.69 MB/s Sep 11 13:58:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Volume volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 (b0bbd14f-2258-4020-aa8a-76be3cbeb1c2): created successfully Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8320368-c6df-4505-868a-7d6b61bea827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Flow 'volume_create_manager' (844a5f29-b48e-47be-b316-dcba015e9313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-93bf82e6-a4e6-4ceb-ae2e-6cf7b6fccd6f tempest-VolumesTransfersV357Test-295611711 None] Created volume successfully. Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b8874-2959-4f6a-bccc-fb5490685674]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:49 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db Sep 11 13:58:49 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:49 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD Sep 11 13:58:49 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:49 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c is fetched for user 350742b7f5074f678f3d2642435b5081. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=152,cinder:INSERT=66,cinder:UPDATE=209,cinder:DELETE=17 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca3bbec-94c2-4425-9681-d9aa42c3d9e2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:50 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD Sep 11 13:58:50 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:50 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" returned: 0 in 0.761s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:50 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f Sep 11 13:58:50 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:50 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1696939219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba50721-4072-4247-836f-b3f828101583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cab9d6a20a4d4d975a025b358977a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:48Z,use_quota=True,user_id='350742b7f5074f678f3d2642435b5081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Creating volume 1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:50 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:50 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 1073741824 Sep 11 13:58:50 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:50 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" returned: 0 in 0.524s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:50 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f Sep 11 13:58:50 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:51 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db.ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" returned: 0 in 0.409s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f" released by "_delete_snapshot" :: held 2.419s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" released by "delete_snapshot" :: held 2.450s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Created reservations ['d4de39e7-93af-4a14-a6be-3eaae5da3401', '0b361e40-dfd9-4527-9097-b5e46219e6a1', '124653c9-affd-42be-8982-8d748550416e', 'f82838a0-4ec9-4d7f-96a3-e8d9986d076f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:51 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 1073741824" returned: 0 in 0.716s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-83062493-a7f6-43c0-9bd6-2edd3741602c tempest-VolumesTransfersV357Test-411716690 None] Transfer volume completed successfully. Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Delete snapshot completed successfully. Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-ae6943d5-bf48-4d6b-95ab-98fa0840ea4f-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Snapshots deleted, issuing volume delete {{(pid=88731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:51 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 Sep 11 13:58:51 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" acquired by "delete_volume" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6d86fa-a197-449a-8411-8f06e3d2c852]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:51 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db Sep 11 13:58:51 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:51 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583" returned: 0 in 0.404s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Attempting download of 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 1ba50721-4072-4247-836f-b3f828101583. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c4104-19be-4e7c-96b9-b187f32ad67d]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:51 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa Sep 11 13:58:51 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Acquiring lock "cinder-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:52 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" returned: 0 in 0.658s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:52 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db Sep 11 13:58:52 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Acquiring lock "cinder-quobyte-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-quobyte-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:52 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa" returned: 0 in 0.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3659ae71-d70d-4c5c-bbb0-919a5e4a5ce3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:52 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa Sep 11 13:58:52 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:52 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 Sep 11 13:58:52 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:52 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" returned: 0 in 0.408s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db" released by "delete_volume" :: held 1.174s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Created reservations ['ca3b6e54-6296-4c61-99b4-f34dbb22ede4', 'bd75d8a5-00de-4ff3-ae85-d8cb4fe215af', '594f8596-1bb0-45dc-b420-b9088450cf60', '1e27c9af-4e83-4ded-a3d5-37af2b6bf77c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:52 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa" returned: 1 in 0.503s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_z415o_qa' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b4308-a731-4ffe-a91c-e2a757b72c3f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:52 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:52 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:52 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2" returned: 0 in 0.641s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:52 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD Sep 11 13:58:52 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:53 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2 Sep 11 13:58:53 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-690be63d-a8cf-47bc-b677-a3c0d2fea100-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-690be63d-a8cf-47bc-b677-a3c0d2fea100-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "cinder-quobyte-690be63d-a8cf-47bc-b677-a3c0d2fea100" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-690be63d-a8cf-47bc-b677-a3c0d2fea100" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:53 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2" returned: 0 in 0.474s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:53 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.606s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Deleted volume successfully. Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-quobyte-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2" released by "delete_volume" :: held 1.193s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561cb26-0922-4601-9c21-3c481128b6e0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:53 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] 6b854647-c6a5-4221-a6fc-d6c3dbc5707c was qcow2, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8a6620e5-ad76-4941-b85d-ef508e563df4 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-e7dad20e-6da8-4f28-9ddb-75c79f2ce0db-delete_volume" released by "delete_volume" :: held 5.138s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:53 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 Sep 11 13:58:53 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Created reservations ['025bd57b-a2aa-4977-803b-471bf4aadb0f', 'c86cca6c-279f-4b0a-8577-100d7ad3be2c', 'f76bc227-b92d-4432-b64c-3f757855dae5', 'dd53e84e-ca49-468d-b9d9-b6095b33815b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:53 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 Sep 11 13:58:53 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:53 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:53 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:53 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100" returned: 0 in 0.491s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:53 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100 Sep 11 13:58:53 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:54 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.345s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Deleted volume successfully. Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-602944c6-42a5-4bd0-b6d8-cb4ec440af5e tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-b0bbd14f-2258-4020-aa8a-76be3cbeb1c2-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Flow 'volume_create_manager' (bc74b1f3-fca9-4ab5-aa7d-c104eac2e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:54 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08c250d-b01e-40ff-9d19-83091d2aaa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-690be63d-a8cf-47bc-b677-a3c0d2fea100" returned: 0 in 0.327s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08c250d-b01e-40ff-9d19-83091d2aaa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-390876792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf40426-0deb-4031-b19e-2640332ba510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226f8ba4314e4ac8adf79b6b67f033de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:54Z,use_quota=True,user_id='02a913bbc1ae42b3988de2cd0d07217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2e60c7-742d-4508-b7be-c270b305bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2e60c7-742d-4508-b7be-c270b305bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543e6b20-51a5-4ba5-bd6a-652682dc9476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543e6b20-51a5-4ba5-bd6a-652682dc9476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf40426-0deb-4031-b19e-2640332ba510', 'volume_name': 'volume-daf40426-0deb-4031-b19e-2640332ba510', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e3f9c0-2588-4de2-9dda-3320a79f95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e3f9c0-2588-4de2-9dda-3320a79f95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc986d65-5d98-448d-8e15-76d2e5c26459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Volume daf40426-0deb-4031-b19e-2640332ba510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf40426-0deb-4031-b19e-2640332ba510', 'volume_size': 1} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-390876792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf40426-0deb-4031-b19e-2640332ba510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226f8ba4314e4ac8adf79b6b67f033de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:54Z,use_quota=True,user_id='02a913bbc1ae42b3988de2cd0d07217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Creating volume daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:54 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-quobyte-690be63d-a8cf-47bc-b677-a3c0d2fea100" released by "delete_volume" :: held 0.971s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:54 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 1073741824 Sep 11 13:58:54 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Created reservations ['0b21541a-c4ee-4561-a96e-3130432f02ed', '2d23f97a-df45-4a1c-8f85-dd8304e6675c', 'a7d3fe65-a1a9-4e5d-907a-90badd99424d', 'e43b5768-b832-4cb4-b0e8-d9d27caab322'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:54 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:54 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:54 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.354s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:54 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Deleted volume successfully. Sep 11 13:58:55 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 1073741824" returned: 0 in 0.676s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d9e58319-47fa-499a-941d-00a760837976 tempest-VolumesDeleteCascade-1890603095 None] Lock "cinder-690be63d-a8cf-47bc-b677-a3c0d2fea100-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:55 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 Sep 11 13:58:55 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Flow 'volume_create_manager' (cbc0d3c4-8b72-41e5-aa11-a693cb142fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263be0b1-b69e-438e-81c7-eecf90fe9216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263be0b1-b69e-438e-81c7-eecf90fe9216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-10838172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b434887-139e-4b82-8115-f10c1f476e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25edd300a2b34225a8ab94a0d5ebbc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:55Z,use_quota=True,user_id='de7900951449497c8b616244a7288724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0553731c-1bc2-4c53-b9bf-a0c9540fa591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0553731c-1bc2-4c53-b9bf-a0c9540fa591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4585ee-0273-4179-9817-d50697e145c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4585ee-0273-4179-9817-d50697e145c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b434887-139e-4b82-8115-f10c1f476e63', 'volume_name': 'volume-9b434887-139e-4b82-8115-f10c1f476e63', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedd6641-b0a3-451e-908b-cd68ee5ebc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedd6641-b0a3-451e-908b-cd68ee5ebc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76897ba3-2c84-4856-8898-0b635498a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Volume 9b434887-139e-4b82-8115-f10c1f476e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b434887-139e-4b82-8115-f10c1f476e63', 'volume_size': 1} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:55 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510" returned: 0 in 0.314s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-10838172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b434887-139e-4b82-8115-f10c1f476e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25edd300a2b34225a8ab94a0d5ebbc6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:58:55Z,use_quota=True,user_id='de7900951449497c8b616244a7288724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Creating volume 9b434887-139e-4b82-8115-f10c1f476e63 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:58:55 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc986d65-5d98-448d-8e15-76d2e5c26459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf40426-0deb-4031-b19e-2640332ba510', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd60e252-f72b-4ed2-a690-d2f9f21371bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:55 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 1073741824 Sep 11 13:58:55 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Volume volume-daf40426-0deb-4031-b19e-2640332ba510 (daf40426-0deb-4031-b19e-2640332ba510): created successfully Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd60e252-f72b-4ed2-a690-d2f9f21371bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Flow 'volume_create_manager' (bc74b1f3-fca9-4ab5-aa7d-c104eac2e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-337f8177-37c2-4b55-b28f-952c628399d9 tempest-SnapshotDependencyTests-2018233345 None] Created volume successfully. Sep 11 13:58:55 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583" returned: 0 in 2.174s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_bfrdg9gddevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:58:55 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Converted 112.00 MB image at 51.50 MB/s Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:55 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 1G Sep 11 13:58:55 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:55 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 1073741824" returned: 0 in 0.526s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:55 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 Sep 11 13:58:55 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:56 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 1G" returned: 0 in 0.366s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Downloaded image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 1ba50721-4072-4247-836f-b3f828101583 successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c for user 350742b7f5074f678f3d2642435b5081 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Marking volume 1ba50721-4072-4247-836f-b3f828101583 as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Copying metadata from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c to 1ba50721-4072-4247-836f-b3f828101583. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Creating volume glance metadata for volume 1ba50721-4072-4247-836f-b3f828101583 backed by image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4416473-d942-4b69-b1e3-08b4cc941087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba50721-4072-4247-836f-b3f828101583', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82237f87-08b3-44a4-b208-07762f6b23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Volume volume-1ba50721-4072-4247-836f-b3f828101583 (1ba50721-4072-4247-836f-b3f828101583): created successfully Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82237f87-08b3-44a4-b208-07762f6b23a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Flow 'volume_create_manager' (4c772a29-2d7f-4ac3-881d-fd33bc8488c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ecee7292-6b08-45e8-8df1-18dc1456b32a tempest-VolumesExtendTest-270376765 None] Created volume successfully. Sep 11 13:58:56 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63" returned: 0 in 0.285s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76897ba3-2c84-4856-8898-0b635498a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b434887-139e-4b82-8115-f10c1f476e63', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eca2e67-d8c9-4071-aec2-79be63359d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:58:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Volume volume-9b434887-139e-4b82-8115-f10c1f476e63 (9b434887-139e-4b82-8115-f10c1f476e63): created successfully Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eca2e67-d8c9-4071-aec2-79be63359d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Flow 'volume_create_manager' (cbc0d3c4-8b72-41e5-aa11-a693cb142fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:58:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-20fa6ad8-da1b-492e-ad5b-527add60bf06 tempest-VolumesTransfersV357Test-295611711 None] Created volume successfully. Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Creating offline snapshot 54fb9673-9c52-463f-ae0a-32235db8cd03 of volume daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5afb5df-4441-46c9-bfcf-78728c00ae41]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:56 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 Sep 11 13:58:56 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Acquiring lock "cinder-9b434887-139e-4b82-8115-f10c1f476e63-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-9b434887-139e-4b82-8115-f10c1f476e63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Acquiring lock "cinder-quobyte-9b434887-139e-4b82-8115-f10c1f476e63" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-quobyte-9b434887-139e-4b82-8115-f10c1f476e63" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95569a-4d5d-4ca3-af53-c257574d92bc]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:57 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 Sep 11 13:58:57 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:57 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510" returned: 0 in 0.478s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:57 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 1G Sep 11 13:58:57 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:57 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63" returned: 0 in 0.483s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:57 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63 Sep 11 13:58:57 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:57 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 1G" returned: 0 in 0.518s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf40426-0deb-4031-b19e-2640332ba510 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:57 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf40426-0deb-4031-b19e-2640332ba510 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 Sep 11 13:58:57 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:57 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9b434887-139e-4b82-8115-f10c1f476e63" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-quobyte-9b434887-139e-4b82-8115-f10c1f476e63" released by "delete_volume" :: held 0.817s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Created reservations ['cd06ebf8-7b72-4208-8391-575312f526ba', '70a77104-f502-419f-b6b6-818b0aec1fe0', '8abf2418-351b-4a6c-a978-ccc92e6f7a5c', '47857fb3-b48c-464f-a881-a9f828830ff4'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:57 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:58:57 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:57 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf40426-0deb-4031-b19e-2640332ba510 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03" returned: 0 in 0.339s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:57 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 is being set with open permissions: ugo+rw Sep 11 13:58:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:58 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 Sep 11 13:58:58 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:58 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.329s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:58:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Deleted volume successfully. Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5791be64-8599-4992-94a9-7112a88f1566 tempest-VolumesTransfersV357Test-1308282507 None] Lock "cinder-9b434887-139e-4b82-8115-f10c1f476e63-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:58:58 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:58 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info Sep 11 13:58:58 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:58 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info" returned: 0 in 0.272s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:58 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info is being set with open permissions: ugo+rw Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:58 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info Sep 11 13:58:58 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:58 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.info" returned: 0 in 0.285s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.706s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5718af-02a5-462d-83ce-47fa516dfe7c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:58:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5e9a2e53-044f-45cf-8737-9db2783961ed tempest-SnapshotDependencyTests-2018233345 None] Create snapshot completed successfully Sep 11 13:58:59 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 Sep 11 13:58:59 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:58:59 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 11 13:58:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 2G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:58:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 2G" returned: 0 in 0.141s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:58:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.561s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:58:59 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-22e145bd-b57d-46c4-b67b-803c68418012 tempest-VolumesExtendTest-270376765 None] Extend volume completed successfully. Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Flow 'volume_create_manager' (ee19ed72-5bf6-4e21-ac80-ddde676e26f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc286ab-ddbf-4a54-859e-6cbaa80d6200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc286ab-ddbf-4a54-859e-6cbaa80d6200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97becbc9-9011-41c0-a453-3a44b37b5e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226f8ba4314e4ac8adf79b6b67f033de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54fb9673-9c52-463f-ae0a-32235db8cd03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:00Z,use_quota=True,user_id='02a913bbc1ae42b3988de2cd0d07217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0805d0-200f-44db-b63d-a6efe43cc9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0805d0-200f-44db-b63d-a6efe43cc9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024b36f4-1fb1-41e1-8990-06539178bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024b36f4-1fb1-41e1-8990-06539178bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97becbc9-9011-41c0-a453-3a44b37b5e74', 'volume_name': 'volume-97becbc9-9011-41c0-a453-3a44b37b5e74', 'volume_size': 1, 'snapshot_id': '54fb9673-9c52-463f-ae0a-32235db8cd03'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2a509f-5123-408c-901d-531b5a7f51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2a509f-5123-408c-901d-531b5a7f51e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5862331-3686-4188-a585-cc308cfea185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:00 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Volume 97becbc9-9011-41c0-a453-3a44b37b5e74: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97becbc9-9011-41c0-a453-3a44b37b5e74', 'volume_size': 1, 'snapshot_id': '54fb9673-9c52-463f-ae0a-32235db8cd03'} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-quobyte-54fb9673-9c52-463f-ae0a-32235db8cd03-97becbc9-9011-41c0-a453-3a44b37b5e74" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-54fb9673-9c52-463f-ae0a-32235db8cd03-97becbc9-9011-41c0-a453-3a44b37b5e74" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Creating volume 97becbc9-9011-41c0-a453-3a44b37b5e74 from snapshot 54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-quobyte-97becbc9-9011-41c0-a453-3a44b37b5e74" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-97becbc9-9011-41c0-a453-3a44b37b5e74" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] snapshot: 54fb9673-9c52-463f-ae0a-32235db8cd03, volume: 97becbc9-9011-41c0-a453-3a44b37b5e74, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ec8153-518a-47f4-aa5b-454f57df9be2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:00 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 Sep 11 13:59:00 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:01 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf40426-0deb-4031-b19e-2640332ba510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b27bbc-689c-4a98-8c70-856f3f449273]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-1ba50721-4072-4247-836f-b3f828101583-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Lock "cinder-1ba50721-4072-4247-836f-b3f828101583-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-quobyte-1ba50721-4072-4247-836f-b3f828101583" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:01 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 Sep 11 13:59:01 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-1ba50721-4072-4247-836f-b3f828101583" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce221cdb-509f-4bf0-8bcf-2709f42f454b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:01 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 Sep 11 13:59:01 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:01 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510" returned: 0 in 0.498s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:01 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 Sep 11 13:59:01 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:01 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583" returned: 0 in 0.489s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:01 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583 Sep 11 13:59:01 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:02 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1ba50721-4072-4247-836f-b3f828101583" returned: 0 in 0.339s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-1ba50721-4072-4247-836f-b3f828101583" released by "delete_volume" :: held 0.924s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Flow 'volume_create_manager' (5793dbe8-d872-4e98-a043-cdc9bdb85b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc1e839-9592-48b5-818d-72b148f19aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc1e839-9592-48b5-818d-72b148f19aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-612616892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef84fb0-6fb0-418b-b8f8-bd199a89bf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37963d1ef614efea2eef8d7a0b1480d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:02Z,use_quota=True,user_id='a6259ed9d5b24deb8523904be4db28bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3818e58-676f-4a8b-88b3-cf458afdfb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3818e58-676f-4a8b-88b3-cf458afdfb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc44d065-d95c-4a18-88f1-a4721e949d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc44d065-d95c-4a18-88f1-a4721e949d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef84fb0-6fb0-418b-b8f8-bd199a89bf21', 'volume_name': 'volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1198c4-47e6-4653-8ed4-ce73428e3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1198c4-47e6-4653-8ed4-ce73428e3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aaf8440-7501-40c6-a9e9-d0d28263f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:02 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Volume 9ef84fb0-6fb0-418b-b8f8-bd199a89bf21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21', 'volume_size': 1} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Created reservations ['eba03d34-b923-4cb0-8e8b-c88a80eb5b48', '64bbd262-2007-4080-add6-dd070e624c9b', '01fa7bfc-93fc-4f58-94cc-f2bf9a87da56', 'ab9d74ac-c1f2-4dad-86e0-af2f61527d20'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:03 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:03 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:03 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.332s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:03 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:03 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Deleted volume successfully. Sep 11 13:59:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-54c88ced-50bd-44e9-aa08-de0de3c1a87a tempest-VolumesExtendTest-270376765 None] Lock "cinder-1ba50721-4072-4247-836f-b3f828101583-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Flow 'volume_create_manager' (3f5d7b49-3616-4991-a8c1-082ea7658e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03692731-819b-40c1-9789-37fab9498dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03692731-819b-40c1-9789-37fab9498dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1967847626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46aac98f-68e0-4e52-8e4d-3d3b7d681ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cab9d6a20a4d4d975a025b358977a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:05Z,use_quota=True,user_id='350742b7f5074f678f3d2642435b5081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345f01c6-810e-4d70-b337-8cc481367878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345f01c6-810e-4d70-b337-8cc481367878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf31c5b-0945-4465-a906-1ac83a6c16cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf31c5b-0945-4465-a906-1ac83a6c16cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46aac98f-68e0-4e52-8e4d-3d3b7d681ac4', 'volume_name': 'volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dc0eec-3beb-4d62-9123-c33bb9aa85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dc0eec-3beb-4d62-9123-c33bb9aa85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9be3a8-613f-48db-986a-e502ca23538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Volume 46aac98f-68e0-4e52-8e4d-3d3b7d681ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4', 'volume_size': 1} Sep 11 13:59:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:07 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74" returned: 0 in 5.554s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 13:59:07 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Converted 1024.00 MB image at 184.35 MB/s Sep 11 13:59:07 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 is being set with open permissions: ugo+rw Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:07 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 Sep 11 13:59:07 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:07 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-97becbc9-9011-41c0-a453-3a44b37b5e74" released by "_copy_volume_from_snapshot" :: held 6.912s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-54fb9673-9c52-463f-ae0a-32235db8cd03-97becbc9-9011-41c0-a453-3a44b37b5e74" released by "_create_volume_from_snapshot" :: held 6.978s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.998s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.792s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-612616892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef84fb0-6fb0-418b-b8f8-bd199a89bf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37963d1ef614efea2eef8d7a0b1480d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:02Z,use_quota=True,user_id='a6259ed9d5b24deb8523904be4db28bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Creating volume 9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:07 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:07 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 1073741824 Sep 11 13:59:07 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5862331-3686-4188-a585-cc308cfea185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97becbc9-9011-41c0-a453-3a44b37b5e74', 'volume_size': 1, 'snapshot_id': '54fb9673-9c52-463f-ae0a-32235db8cd03'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704b8e1c-4e9e-4f15-bba7-93a96b034aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Volume volume-97becbc9-9011-41c0-a453-3a44b37b5e74 (97becbc9-9011-41c0-a453-3a44b37b5e74): created successfully Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704b8e1c-4e9e-4f15-bba7-93a96b034aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Flow 'volume_create_manager' (ee19ed72-5bf6-4e21-ac80-ddde676e26f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b92de603-3635-4532-825e-f346c8dd0e04 tempest-SnapshotDependencyTests-2018233345 None] Created volume successfully. Sep 11 13:59:08 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 1073741824" returned: 0 in 0.468s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:08 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 Sep 11 13:59:08 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:08 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1967847626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46aac98f-68e0-4e52-8e4d-3d3b7d681ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cab9d6a20a4d4d975a025b358977a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:05Z,use_quota=True,user_id='350742b7f5074f678f3d2642435b5081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Creating volume 46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:08 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aaf8440-7501-40c6-a9e9-d0d28263f470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3beb7771-26ff-4581-b479-897ab8e8e23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:08 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 1073741824 Sep 11 13:59:08 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-54fb9673-9c52-463f-ae0a-32235db8cd03-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Volume volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 (9ef84fb0-6fb0-418b-b8f8-bd199a89bf21): created successfully Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3beb7771-26ff-4581-b479-897ab8e8e23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Flow 'volume_create_manager' (5793dbe8-d872-4e98-a043-cdc9bdb85b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-54fb9673-9c52-463f-ae0a-32235db8cd03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-quobyte-daf40426-0deb-4031-b19e-2640332ba510" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a1025563-4dd6-4927-9dd4-da1368b77fb5 tempest-VolumesTransfersTest-2067022920 None] Created volume successfully. Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-daf40426-0deb-4031-b19e-2640332ba510" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-quobyte-54fb9673-9c52-463f-ae0a-32235db8cd03" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-54fb9673-9c52-463f-ae0a-32235db8cd03" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Deleting offline snapshot 54fb9673-9c52-463f-ae0a-32235db8cd03 of volume daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] snapshot_file for this snap is: volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c05c086-02f2-4d01-b2a1-433b03e16951]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:08 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 Sep 11 13:59:08 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:08 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 1073741824" returned: 0 in 0.491s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:08 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 Sep 11 13:59:08 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:08 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03" returned: 0 in 0.440s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf40426-0deb-4031-b19e-2640332ba510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fce1ec-8b5c-4181-be5e-b2ae8cfb34a2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:09 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 Sep 11 13:59:09 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:09 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" returned: 0 in 0.348s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9be3a8-613f-48db-986a-e502ca23538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4247d801-ff5e-46d6-bae7-b66a57c42f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:09 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Volume volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 (46aac98f-68e0-4e52-8e4d-3d3b7d681ac4): created successfully Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4247d801-ff5e-46d6-bae7-b66a57c42f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Flow 'volume_create_manager' (3f5d7b49-3616-4991-a8c1-082ea7658e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-da2d37e1-ce86-432a-a518-0efa5db14eaa tempest-VolumesExtendTest-270376765 None] Created volume successfully. Sep 11 13:59:09 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510" returned: 0 in 0.670s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:09 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 Sep 11 13:59:09 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-17ffd225-da0c-4a0f-b81c-97c56d3a11a0 tempest-VolumesTransfersTest-1811202538 None] Transfer volume completed successfully. Sep 11 13:59:10 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03" returned: 0 in 0.403s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:10 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03 Sep 11 13:59:10 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:10 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510.54fb9673-9c52-463f-ae0a-32235db8cd03" returned: 0 in 0.329s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-54fb9673-9c52-463f-ae0a-32235db8cd03" released by "_delete_snapshot" :: held 1.965s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-daf40426-0deb-4031-b19e-2640332ba510" released by "delete_snapshot" :: held 1.990s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:10 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:10 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Acquiring lock "cinder-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Created reservations ['04082f77-5ff7-4998-93b8-9ba16101bc60', '6e8cba1c-686c-4c65-a78a-2048f7b0f2b7', 'a05bb507-fb55-42b6-97ae-eb754f858c6d', '9b986d81-419b-4f38-86de-c310478e2c8a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Creating offline snapshot 700496f1-073a-4f3e-b7f6-e2dc45ec65c1 of volume 46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c294020-18a8-466f-a360-fbfbed25f6ce]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Acquiring lock "cinder-quobyte-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-quobyte-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Delete snapshot completed successfully. Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cd904658-c862-4f17-9cb2-d9974d6e9249 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-54fb9673-9c52-463f-ae0a-32235db8cd03-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc3d7a0-5552-4916-9881-0d7100c9e820]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:10 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.374s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:10 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 Sep 11 13:59:10 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 13:59:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 13:59:11 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 Sep 11 13:59:11 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:11 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" returned: 0 in 0.440s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:11 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 1G Sep 11 13:59:11 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:11 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21" returned: 0 in 0.409s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:11 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21 Sep 11 13:59:11 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:11 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 1G" returned: 0 in 0.388s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:11 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21" returned: 0 in 0.272s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:11 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 Sep 11 13:59:11 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-quobyte-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21" released by "delete_volume" :: held 0.748s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Created reservations ['fcb747b7-ef9c-49a7-b3c6-19ecec7dc41a', 'd677ebba-f37f-4253-9666-ce08bbcdcb90', '6d40dcff-ad2a-4c6a-88bb-2f857295488b', 'ca85edf8-f23e-48dc-ba3b-c50e6c36134b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-daf40426-0deb-4031-b19e-2640332ba510-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-daf40426-0deb-4031-b19e-2640332ba510-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-quobyte-daf40426-0deb-4031-b19e-2640332ba510" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:11 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:11 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-daf40426-0deb-4031-b19e-2640332ba510" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29893ba-c062-46be-b3a4-2d2a77d18866]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:12 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1" returned: 0 in 0.598s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:12 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 is being set with open permissions: ugo+rw Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:12 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.411s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:12 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 Sep 11 13:59:12 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Deleted volume successfully. Sep 11 13:59:12 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 Sep 11 13:59:12 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e7d2623-0342-498d-beae-6cf7d3f7ffb0 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-9ef84fb0-6fb0-418b-b8f8-bd199a89bf21-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:12 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1" returned: 0 in 0.338s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:12 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info Sep 11 13:59:12 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:12 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510" returned: 0 in 0.728s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:12 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510 Sep 11 13:59:12 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Flow 'volume_create_manager' (7f5bfc92-3111-4a64-b419-dd9dcdd92da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f003154-444f-4bda-b242-688d0f2ac00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:12 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info" returned: 0 in 0.371s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:12 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info is being set with open permissions: ugo+rw Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f003154-444f-4bda-b242-688d0f2ac00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1062637452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be400aa-fae8-4a18-9490-8da40fe6cb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37963d1ef614efea2eef8d7a0b1480d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:13Z,use_quota=True,user_id='a6259ed9d5b24deb8523904be4db28bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e369744-72cd-4c79-a4cc-2eba88ee4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e369744-72cd-4c79-a4cc-2eba88ee4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2432964-f4f7-4490-8cd7-38425af262c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2432964-f4f7-4490-8cd7-38425af262c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be400aa-fae8-4a18-9490-8da40fe6cb27', 'volume_name': 'volume-3be400aa-fae8-4a18-9490-8da40fe6cb27', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:12 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info Sep 11 13:59:12 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d09058-5ab7-47ab-bba1-dbe87ac0faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d09058-5ab7-47ab-bba1-dbe87ac0faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33304b4-368c-4631-87f2-e5522103af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:12 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Volume 3be400aa-fae8-4a18-9490-8da40fe6cb27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be400aa-fae8-4a18-9490-8da40fe6cb27', 'volume_size': 1} Sep 11 13:59:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:13 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-daf40426-0deb-4031-b19e-2640332ba510" returned: 0 in 0.357s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-daf40426-0deb-4031-b19e-2640332ba510" released by "delete_volume" :: held 1.216s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Created reservations ['2108d9fe-3dfb-45ce-aa4e-aad64eff7242', '8e31676f-a656-4e32-8a04-32af99bf7b17', '309bb752-57c9-4c4c-b145-7fba8b4fac43', '7bfa125f-3094-4326-aa00-aef259fc0d42'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:13 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:13 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:13 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.info" returned: 0 in 0.306s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.266s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1062637452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be400aa-fae8-4a18-9490-8da40fe6cb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37963d1ef614efea2eef8d7a0b1480d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:13Z,use_quota=True,user_id='a6259ed9d5b24deb8523904be4db28bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Creating volume 3be400aa-fae8-4a18-9490-8da40fe6cb27 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:13 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:13 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 1073741824 Sep 11 13:59:13 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5799d438-0b56-4c52-a0ff-cff7cd4822b5 tempest-VolumesExtendTest-270376765 None] Create snapshot completed successfully Sep 11 13:59:13 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Deleted volume successfully. Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b65e60b7-d52c-423d-9d2e-a06decefc611 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-daf40426-0deb-4031-b19e-2640332ba510-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:13 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 1073741824" returned: 0 in 0.540s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:13 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 Sep 11 13:59:13 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-97becbc9-9011-41c0-a453-3a44b37b5e74-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-97becbc9-9011-41c0-a453-3a44b37b5e74-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "cinder-quobyte-97becbc9-9011-41c0-a453-3a44b37b5e74" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-97becbc9-9011-41c0-a453-3a44b37b5e74" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd03dfc-7e62-4408-b264-2135c453ef58]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:14 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27" returned: 0 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.249s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33304b4-368c-4631-87f2-e5522103af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be400aa-fae8-4a18-9490-8da40fe6cb27', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602a76da-0927-4caa-b5a1-a9575cde8bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c33d459-84c1-4b5f-ab62-4e4bfdfe8730]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Volume volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 (3be400aa-fae8-4a18-9490-8da40fe6cb27): created successfully Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602a76da-0927-4caa-b5a1-a9575cde8bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Flow 'volume_create_manager' (7f5bfc92-3111-4a64-b419-dd9dcdd92da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5230ec7f-9991-4f46-b4aa-72e3ebc9fde0 tempest-VolumesTransfersTest-2067022920 None] Created volume successfully. Sep 11 13:59:14 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 Sep 11 13:59:14 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:14 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 Sep 11 13:59:14 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:14 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74" returned: 0 in 0.410s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:14 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74 Sep 11 13:59:14 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:14 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" returned: 0 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 2G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 2G" returned: 0 in 0.172s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.648s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cea7ea12-c303-4bf7-92e6-4b22ae19cf4d tempest-VolumesExtendTest-270376765 None] Extend volume completed successfully. Sep 11 13:59:14 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-97becbc9-9011-41c0-a453-3a44b37b5e74" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-quobyte-97becbc9-9011-41c0-a453-3a44b37b5e74" released by "delete_volume" :: held 0.806s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:14 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Created reservations ['f9c68215-5cd8-48c5-8f67-9e0c53dccfdd', '29868313-d6a6-4461-9af6-5e0967eed218', 'b78b584f-00a6-45ad-8a53-b1e3d2a118d4', 'cd599ea2-0cb8-4b1d-89e8-7ccd58c0c5cb'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:15 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:15 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-700496f1-073a-4f3e-b7f6-e2dc45ec65c1-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Lock "cinder-700496f1-073a-4f3e-b7f6-e2dc45ec65c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-quobyte-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-quobyte-700496f1-073a-4f3e-b7f6-e2dc45ec65c1" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-700496f1-073a-4f3e-b7f6-e2dc45ec65c1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Deleting offline snapshot 700496f1-073a-4f3e-b7f6-e2dc45ec65c1 of volume 46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] snapshot_file for this snap is: volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Acquiring lock "cinder-3be400aa-fae8-4a18-9490-8da40fe6cb27-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3863bd47-279e-4009-9e91-daa699ca70e7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:15 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.421s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Deleted volume successfully. Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-3be400aa-fae8-4a18-9490-8da40fe6cb27-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-efb91f24-efe2-4ef5-86f0-908c051ef334 tempest-SnapshotDependencyTests-2018233345 None] Lock "cinder-97becbc9-9011-41c0-a453-3a44b37b5e74-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Acquiring lock "cinder-quobyte-3be400aa-fae8-4a18-9490-8da40fe6cb27" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-quobyte-3be400aa-fae8-4a18-9490-8da40fe6cb27" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb09bc-5b26-4008-94c2-c29c00549ceb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:15 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 Sep 11 13:59:15 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:15 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 Sep 11 13:59:15 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:16 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1" returned: 0 in 0.591s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1d16cb-c0b6-41ac-8363-4919b03c24aa]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:16 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27" returned: 0 in 0.460s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:16 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27 Sep 11 13:59:16 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:16 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 Sep 11 13:59:16 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:16 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3be400aa-fae8-4a18-9490-8da40fe6cb27" returned: 0 in 0.279s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-quobyte-3be400aa-fae8-4a18-9490-8da40fe6cb27" released by "delete_volume" :: held 0.810s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Created reservations ['3af5e30c-4df7-4329-8f03-f49c1d8fb175', 'f0717e4f-c643-4712-a485-8c5fdc40251f', '00b843ad-675f-4c1f-bd2c-8c7ba2e94110', 'd4c24766-34e1-4e91-a36a-dce479ae1332'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:16 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" returned: 0 in 0.572s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:16 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:16 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:16 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 Sep 11 13:59:16 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:16 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Deleted volume successfully. Sep 11 13:59:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16400030-e51b-4f51-b297-fd581b2ca6d4 tempest-VolumesTransfersTest-54414224 None] Lock "cinder-3be400aa-fae8-4a18-9490-8da40fe6cb27-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:17 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1" returned: 0 in 0.465s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:17 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1 Sep 11 13:59:17 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:17 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4.700496f1-073a-4f3e-b7f6-e2dc45ec65c1" returned: 0 in 0.288s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-700496f1-073a-4f3e-b7f6-e2dc45ec65c1" released by "_delete_snapshot" :: held 2.083s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" released by "delete_snapshot" :: held 2.133s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Created reservations ['926e4dc2-17ec-436f-87f8-e33f79691078', 'f4cf4c5e-a5c9-45c3-9a2d-c1f77274267e', '1fb0c096-9690-45bc-8a50-db00eeeefd29', 'd4614233-ab0a-4cc8-adb1-1588312e70a1'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Delete snapshot completed successfully. Sep 11 13:59:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f8d3b504-4ca9-4ca7-8fda-9738674dbf13 tempest-VolumesExtendTest-270376765 None] Lock "cinder-700496f1-073a-4f3e-b7f6-e2dc45ec65c1-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Lock "cinder-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Acquiring lock "cinder-quobyte-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d597dc60-1178-4ebc-8ce6-e59a6a207142]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:18 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 Sep 11 13:59:18 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:19 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" returned: 0 in 0.498s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:19 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4 Sep 11 13:59:19 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:19 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" returned: 0 in 0.344s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Lock "cinder-quobyte-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4" released by "delete_volume" :: held 0.946s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Created reservations ['afbddf98-7f72-41b8-9712-d17695dd9c60', '20bebdf5-78b1-4fbe-ba81-417172817f95', '5326c417-f1f1-428f-8415-c9b895cdf5be', '62f4d3e2-c3df-42e4-896c-58af10bbc0ce'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:19 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:19 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:20 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.362s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Deleted volume successfully. Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3a18f812-c59d-4021-8e73-6bf5d75c8be4 tempest-VolumesExtendTest-270376765 None] Lock "cinder-46aac98f-68e0-4e52-8e4d-3d3b7d681ac4-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Flow 'volume_create_manager' (9d3864c4-2f72-4a44-8bd2-bb94b0c4e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72533064-21cd-4d03-85a1-9278c4658472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72533064-21cd-4d03-85a1-9278c4658472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2124247044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8706e336-85a2-4d7f-ab35-4b3cb5ec2daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adcbf98a98a4411ac9230a176a3c150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:20Z,use_quota=True,user_id='0a8a293fafbe418c940c28e32a8d7628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ac4357-c78e-450d-ae1d-dd49bd2a7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ac4357-c78e-450d-ae1d-dd49bd2a7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e4a86a-fd35-4bdf-8b9a-01c3ae4b5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e4a86a-fd35-4bdf-8b9a-01c3ae4b5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8706e336-85a2-4d7f-ab35-4b3cb5ec2daf', 'volume_name': 'volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80caa03a-0388-4a20-be18-d5916d24e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80caa03a-0388-4a20-be18-d5916d24e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff36fcd-f937-4a11-a6f4-7421c7a0d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:20 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Volume 8706e336-85a2-4d7f-ab35-4b3cb5ec2daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf', 'volume_size': 1} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2124247044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8706e336-85a2-4d7f-ab35-4b3cb5ec2daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adcbf98a98a4411ac9230a176a3c150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:20Z,use_quota=True,user_id='0a8a293fafbe418c940c28e32a8d7628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Creating volume 8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:20 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:20 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf 1073741824 Sep 11 13:59:20 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:21 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf 1073741824" returned: 0 in 0.528s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:21 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 13:59:21 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:21 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.393s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff36fcd-f937-4a11-a6f4-7421c7a0d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a3a6b9-3632-4b87-8401-b8bee795e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:21 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Volume volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf (8706e336-85a2-4d7f-ab35-4b3cb5ec2daf): created successfully Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a3a6b9-3632-4b87-8401-b8bee795e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Flow 'volume_create_manager' (9d3864c4-2f72-4a44-8bd2-bb94b0c4e0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cfb8fbf8-ba5b-4ebd-9c6b-c6adb429cee7 tempest-VolumesActionsTest-1295067300 None] Created volume successfully. Sep 11 13:59:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Flow 'volume_create_manager' (f6898fab-316c-40fe-9744-5ceb447a16d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd5b0b2-ccab-4892-a350-55d3e6fdb215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd5b0b2-ccab-4892-a350-55d3e6fdb215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1756318768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3167cdb9-622d-4c42-bd4a-daa2bd08b899,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3c171316893455c91a331801083e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:27Z,use_quota=True,user_id='b6d5dabbd92f45949b52e016f42e9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9294d4c6-fc76-49e8-9bdf-eefeebfc200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9294d4c6-fc76-49e8-9bdf-eefeebfc200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bbe3ec-ea63-4504-9f73-7e4276fbd104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bbe3ec-ea63-4504-9f73-7e4276fbd104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3167cdb9-622d-4c42-bd4a-daa2bd08b899', 'volume_name': 'volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b9ddde-6c26-4a3b-9471-a5ea36169992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b9ddde-6c26-4a3b-9471-a5ea36169992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b5b703-a362-4393-8557-bc155a67487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:27 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Volume 3167cdb9-622d-4c42-bd4a-daa2bd08b899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899', 'volume_size': 1} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1756318768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3167cdb9-622d-4c42-bd4a-daa2bd08b899,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3c171316893455c91a331801083e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:27Z,use_quota=True,user_id='b6d5dabbd92f45949b52e016f42e9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Creating volume 3167cdb9-622d-4c42-bd4a-daa2bd08b899 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:27 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:27 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 1073741824 Sep 11 13:59:27 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:27 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 1073741824" returned: 0 in 0.551s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:27 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 Sep 11 13:59:27 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:28 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899" returned: 0 in 0.294s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b5b703-a362-4393-8557-bc155a67487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca61a6b7-6e01-4cbd-bb27-8b591af51625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Volume volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 (3167cdb9-622d-4c42-bd4a-daa2bd08b899): created successfully Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca61a6b7-6e01-4cbd-bb27-8b591af51625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Flow 'volume_create_manager' (f6898fab-316c-40fe-9744-5ceb447a16d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-74835e5f-143d-46f3-a6f4-9e8f26146ad1 tempest-VolumesListTestJSON-717579510 None] Created volume successfully. Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Flow 'volume_create_manager' (1a2178c6-093d-49ca-83d0-2c844ee310f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c65a5d1-1991-4b1e-a0f5-b2f6e2d09a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c65a5d1-1991-4b1e-a0f5-b2f6e2d09a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-302891396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d279bc74-18bf-465f-aed0-cd58fb7731c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3c171316893455c91a331801083e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:30Z,use_quota=True,user_id='b6d5dabbd92f45949b52e016f42e9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca985cd6-7725-40fa-bee5-a358361c318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca985cd6-7725-40fa-bee5-a358361c318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b206ff2-3b66-4053-bcae-1319f945ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b206ff2-3b66-4053-bcae-1319f945ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd279bc74-18bf-465f-aed0-cd58fb7731c5', 'volume_name': 'volume-d279bc74-18bf-465f-aed0-cd58fb7731c5', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d339842-cbf8-4f1c-b772-8b568283ed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d339842-cbf8-4f1c-b772-8b568283ed90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0b22aa-f02e-4514-9830-92c4f9f8372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Volume d279bc74-18bf-465f-aed0-cd58fb7731c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d279bc74-18bf-465f-aed0-cd58fb7731c5', 'volume_size': 1} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-302891396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d279bc74-18bf-465f-aed0-cd58fb7731c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3c171316893455c91a331801083e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:30Z,use_quota=True,user_id='b6d5dabbd92f45949b52e016f42e9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Creating volume d279bc74-18bf-465f-aed0-cd58fb7731c5 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:30 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:30 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 1073741824 Sep 11 13:59:30 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:30 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 1073741824" returned: 0 in 0.555s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:30 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 Sep 11 13:59:30 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:30 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0b22aa-f02e-4514-9830-92c4f9f8372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d279bc74-18bf-465f-aed0-cd58fb7731c5', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c565004-cf4e-4292-a421-7d4291939b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:30 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Volume volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 (d279bc74-18bf-465f-aed0-cd58fb7731c5): created successfully Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c565004-cf4e-4292-a421-7d4291939b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Flow 'volume_create_manager' (1a2178c6-093d-49ca-83d0-2c844ee310f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-65d73389-6877-4a4b-988d-c85694b77edc tempest-VolumesListTestJSON-717579510 None] Created volume successfully. Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Flow 'volume_create_manager' (e91f7ada-ca56-46cb-a365-a71802d9e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98c0f40-b8ee-4cfb-827d-5249b1fa13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98c0f40-b8ee-4cfb-827d-5249b1fa13bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971727959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43241d4b-19ae-4ba8-8ec6-f195d5e36898,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3c171316893455c91a331801083e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:33Z,use_quota=True,user_id='b6d5dabbd92f45949b52e016f42e9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f92a47b-684f-4f9c-8a88-808a2599e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f92a47b-684f-4f9c-8a88-808a2599e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8d4be3-8876-4e5b-8964-9540a3e5aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8d4be3-8876-4e5b-8964-9540a3e5aa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43241d4b-19ae-4ba8-8ec6-f195d5e36898', 'volume_name': 'volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03af1c1c-4144-4ef9-8b4f-8bddca37183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03af1c1c-4144-4ef9-8b4f-8bddca37183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc530c-7299-4bd3-b630-59172237fee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Volume 43241d4b-19ae-4ba8-8ec6-f195d5e36898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898', 'volume_size': 1} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971727959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43241d4b-19ae-4ba8-8ec6-f195d5e36898,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3c171316893455c91a331801083e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:33Z,use_quota=True,user_id='b6d5dabbd92f45949b52e016f42e9d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Creating volume 43241d4b-19ae-4ba8-8ec6-f195d5e36898 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:32 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:32 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 1073741824 Sep 11 13:59:32 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:33 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 1073741824" returned: 0 in 0.900s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:33 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 Sep 11 13:59:33 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:34 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898" returned: 0 in 0.557s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc530c-7299-4bd3-b630-59172237fee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a3b1ab-2ade-4220-8de0-d50fa91fcdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Volume volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 (43241d4b-19ae-4ba8-8ec6-f195d5e36898): created successfully Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a3b1ab-2ade-4220-8de0-d50fa91fcdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Flow 'volume_create_manager' (e91f7ada-ca56-46cb-a365-a71802d9e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1bd2c962-f0ba-4a78-a028-da0a5e9b04e9 tempest-VolumesListTestJSON-717579510 None] Created volume successfully. Sep 11 13:59:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-418bb3ba-ae2e-4997-b7ae-8c195e7bc7b1 tempest-VolumesActionsTest-1295067300 None] Acquiring lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" by "attach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-418bb3ba-ae2e-4997-b7ae-8c195e7bc7b1 tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" acquired by "attach_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-418bb3ba-ae2e-4997-b7ae-8c195e7bc7b1 tempest-VolumesActionsTest-1295067300 None] Attaching volume 8706e336-85a2-4d7f-ab35-4b3cb5ec2daf to instance f6dfe581-aa80-4c1d-9e9d-23ef8b5b1216 at mountpoint /dev/vdb on host None. Sep 11 13:59:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-418bb3ba-ae2e-4997-b7ae-8c195e7bc7b1 tempest-VolumesActionsTest-1295067300 None] Attach volume completed successfully. Sep 11 13:59:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-418bb3ba-ae2e-4997-b7ae-8c195e7bc7b1 tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" released by "attach_volume" :: held 0.186s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1bbe2fa-23f6-49bd-a13c-ed1f04c203ef tempest-VolumesActionsTest-1295067300 None] Acquiring lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-detach_volume" by "detach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1bbe2fa-23f6-49bd-a13c-ed1f04c203ef tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d1bbe2fa-23f6-49bd-a13c-ed1f04c203ef tempest-VolumesActionsTest-1295067300 None] Detaching volume 8706e336-85a2-4d7f-ab35-4b3cb5ec2daf from instance f6dfe581-aa80-4c1d-9e9d-23ef8b5b1216. Sep 11 13:59:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d1bbe2fa-23f6-49bd-a13c-ed1f04c203ef tempest-VolumesActionsTest-1295067300 None] Detach volume completed successfully. Sep 11 13:59:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1bbe2fa-23f6-49bd-a13c-ed1f04c203ef tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Acquiring lock "cinder-43241d4b-19ae-4ba8-8ec6-f195d5e36898-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-43241d4b-19ae-4ba8-8ec6-f195d5e36898-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Acquiring lock "cinder-quobyte-43241d4b-19ae-4ba8-8ec6-f195d5e36898" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-quobyte-43241d4b-19ae-4ba8-8ec6-f195d5e36898" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eaeed5-2e59-45c3-8db3-01f65baca1cb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:38 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 Sep 11 13:59:38 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:38 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898" returned: 0 in 0.463s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:38 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898 Sep 11 13:59:38 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:38 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43241d4b-19ae-4ba8-8ec6-f195d5e36898" returned: 0 in 0.261s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-quobyte-43241d4b-19ae-4ba8-8ec6-f195d5e36898" released by "delete_volume" :: held 0.795s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Created reservations ['b8a2dd12-8caa-40f3-b3e6-b9d762567009', '1a181110-8c75-47b5-a028-b51aa55b95a5', '5b0942f7-1688-44c9-a644-dfd7d0887ccb', 'b457272b-4324-41a5-817f-d8d42addd65f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:38 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:38 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Acquiring lock "cinder-d279bc74-18bf-465f-aed0-cd58fb7731c5-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-d279bc74-18bf-465f-aed0-cd58fb7731c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Acquiring lock "cinder-quobyte-d279bc74-18bf-465f-aed0-cd58fb7731c5" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-quobyte-d279bc74-18bf-465f-aed0-cd58fb7731c5" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:39 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.313s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Deleted volume successfully. Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c7dc8-0ee1-4a68-be95-80b51a49dc4e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1ea8537c-8b9a-40dd-8945-515b488e2e1e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-43241d4b-19ae-4ba8-8ec6-f195d5e36898-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:39 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 Sep 11 13:59:39 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:39 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:39 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5 Sep 11 13:59:39 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:39 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d279bc74-18bf-465f-aed0-cd58fb7731c5" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-quobyte-d279bc74-18bf-465f-aed0-cd58fb7731c5" released by "delete_volume" :: held 0.794s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Created reservations ['9e194ac2-16e1-435b-a088-cda5edfa8803', '93ffc07a-5313-486e-950f-bb12235d8930', '9826e490-4bcd-4160-8803-cf84827cc2eb', '01dff704-63f4-490b-b996-83bfb8e0a903'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:40 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:40 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "cinder-3167cdb9-622d-4c42-bd4a-daa2bd08b899-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Lock "cinder-3167cdb9-622d-4c42-bd4a-daa2bd08b899-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "cinder-quobyte-3167cdb9-622d-4c42-bd4a-daa2bd08b899" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Lock "cinder-quobyte-3167cdb9-622d-4c42-bd4a-daa2bd08b899" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:40 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.341s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Deleted volume successfully. Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5781e997-1684-4a68-973d-34aa028eb38f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07c18bea-c003-46fd-b8bf-efd1938a704e tempest-VolumesListTestJSON-717579510 None] Lock "cinder-d279bc74-18bf-465f-aed0-cd58fb7731c5-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:40 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 Sep 11 13:59:40 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:40 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899" returned: 0 in 0.477s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:41 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899 Sep 11 13:59:41 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:41 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3167cdb9-622d-4c42-bd4a-daa2bd08b899" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Lock "cinder-quobyte-3167cdb9-622d-4c42-bd4a-daa2bd08b899" released by "delete_volume" :: held 0.844s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Created reservations ['70e76f48-234e-4ace-9cc6-8867196382bf', '05aa062a-98cf-48cf-8f01-3d404cd794d7', 'ae847234-75c9-4217-be7d-df82438e630f', '2f98c11f-c459-45eb-b89e-2709ea0601d9'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:41 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:41 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:41 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.398s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Deleted volume successfully. Sep 11 13:59:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c2370b9-e4e1-4c3d-8787-bf231106c629 tempest-VolumesListTestJSON-717579510 None] Lock "cinder-3167cdb9-622d-4c42-bd4a-daa2bd08b899-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Flow 'volume_create_manager' (c416ceaf-d983-4188-a004-e0e3be2ecc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1256d8e2-8f7f-46a7-9e28-eaabc84fdcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1256d8e2-8f7f-46a7-9e28-eaabc84fdcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1182817536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005ffe98-d511-4a0d-be6c-bfd0d25b76a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742172062ed4ad8a4b15d787c9e6e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:49Z,use_quota=True,user_id='46743264fbd8431cb4383a844377d1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15442a8e-eaad-4083-84e1-ec1b01fe1bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15442a8e-eaad-4083-84e1-ec1b01fe1bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00237872-d5c0-471e-876d-43ac65c125a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00237872-d5c0-471e-876d-43ac65c125a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005ffe98-d511-4a0d-be6c-bfd0d25b76a2', 'volume_name': 'volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2', 'volume_size': 2}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42396224-5f2f-4cd8-ac2d-313b166feb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42396224-5f2f-4cd8-ac2d-313b166feb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390f0175-5755-4b44-a52d-35f601ee2464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Volume 005ffe98-d511-4a0d-be6c-bfd0d25b76a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2', 'volume_size': 2} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T11:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1182817536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005ffe98-d511-4a0d-be6c-bfd0d25b76a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742172062ed4ad8a4b15d787c9e6e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T11:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T11:59:49Z,use_quota=True,user_id='46743264fbd8431cb4383a844377d1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Creating volume 005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 13:59:48 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 13:59:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 2147483648 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:48 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 2147483648 Sep 11 13:59:48 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1398efd-fa4f-49b2-b0c5-02674f7a27bc tempest-VolumesActionsTest-1295067300 None] Acquiring lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" by "attach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1398efd-fa4f-49b2-b0c5-02674f7a27bc tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" acquired by "attach_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f1398efd-fa4f-49b2-b0c5-02674f7a27bc tempest-VolumesActionsTest-1295067300 None] Attaching volume 8706e336-85a2-4d7f-ab35-4b3cb5ec2daf to instance 8bba9e27-88c5-4e01-8a8a-b9b1e2db59af at mountpoint /dev/vdb on host None. Sep 11 13:59:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f1398efd-fa4f-49b2-b0c5-02674f7a27bc tempest-VolumesActionsTest-1295067300 None] Attach volume completed successfully. Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f1398efd-fa4f-49b2-b0c5-02674f7a27bc tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" released by "attach_volume" :: held 0.104s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:49 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 2147483648" returned: 0 in 0.704s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:DELETE=14,cinder:SELECT=132,cinder:INSERT=49,cinder:UPDATE=174 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:49 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 Sep 11 13:59:49 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-99605932-cadd-43ec-86b0-11f45f9b05a6 tempest-VolumesActionsTest-1295067300 None] Acquiring lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-detach_volume" by "detach_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-99605932-cadd-43ec-86b0-11f45f9b05a6 tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-99605932-cadd-43ec-86b0-11f45f9b05a6 tempest-VolumesActionsTest-1295067300 None] Detaching volume 8706e336-85a2-4d7f-ab35-4b3cb5ec2daf from instance 8bba9e27-88c5-4e01-8a8a-b9b1e2db59af. Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=134,cinder:INSERT=46,cinder:UPDATE=163,cinder:DELETE=13 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 13:59:50 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" returned: 0 in 0.543s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390f0175-5755-4b44-a52d-35f601ee2464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2', 'volume_size': 2}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e560514c-93c0-4631-9151-f9d6034a03fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 13:59:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-99605932-cadd-43ec-86b0-11f45f9b05a6 tempest-VolumesActionsTest-1295067300 None] Detach volume completed successfully. Sep 11 13:59:50 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Volume volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 (005ffe98-d511-4a0d-be6c-bfd0d25b76a2): created successfully Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e560514c-93c0-4631-9151-f9d6034a03fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Flow 'volume_create_manager' (c416ceaf-d983-4188-a004-e0e3be2ecc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 13:59:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-99605932-cadd-43ec-86b0-11f45f9b05a6 tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0a997a90-a25e-4979-ac0f-69d472ad2878 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Created volume successfully. Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Creating offline snapshot 15103bfe-274a-42db-b0b0-238f0791c64b of volume 005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f435f-89a8-4af9-8b52-0297b8270f44]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:51 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 Sep 11 13:59:51 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:51 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" returned: 0 in 0.398s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b 2G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:51 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b 2G Sep 11 13:59:51 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:52 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b 2G" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:52 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b Sep 11 13:59:52 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:52 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b" returned: 0 in 0.326s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:52 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b is being set with open permissions: ugo+rw Sep 11 13:59:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:52 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b Sep 11 13:59:52 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:52 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b" returned: 0 in 0.309s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:52 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info Sep 11 13:59:52 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:53 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info" returned: 0 in 0.354s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:53 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info is being set with open permissions: ugo+rw Sep 11 13:59:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:53 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info Sep 11 13:59:53 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:53 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.info" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-45232c61-444f-4394-bcbd-6f557475ecd1 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Create snapshot completed successfully Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "cinder-15103bfe-274a-42db-b0b0-238f0791c64b-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-15103bfe-274a-42db-b0b0-238f0791c64b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "cinder-quobyte-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-quobyte-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "cinder-quobyte-15103bfe-274a-42db-b0b0-238f0791c64b" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-quobyte-15103bfe-274a-42db-b0b0-238f0791c64b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Deleting offline snapshot 15103bfe-274a-42db-b0b0-238f0791c64b of volume 005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] snapshot_file for this snap is: volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3263830a-77cc-443a-a405-fd63124baa0d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:54 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b Sep 11 13:59:54 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:54 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b" returned: 0 in 0.410s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea4eca9-efc9-4111-bfab-f191a4cc2bf7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:55 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 Sep 11 13:59:55 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd124ca-0e75-4bf7-916e-40874405c1c8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:55 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" returned: 0 in 0.422s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:55 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b Sep 11 13:59:55 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:55 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 13:59:55 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:55 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b" returned: 0 in 0.378s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:55 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.450s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:55 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b Sep 11 13:59:55 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9e2c37-4f8d-4874-b794-808f9684f2c2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:55 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 13:59:55 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:56 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2.15103bfe-274a-42db-b0b0-238f0791c64b" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-quobyte-15103bfe-274a-42db-b0b0-238f0791c64b" released by "_delete_snapshot" :: held 1.646s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-quobyte-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" released by "delete_snapshot" :: held 1.676s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Created reservations ['a5dd9d7f-acdd-40f7-9529-dd293a1c99b8', '6de14f7b-2794-4f87-8838-f3ec70fe80c8', '8553377e-7b1a-46c9-9a93-cba734d6036a', '453c5ab8-4c08-4384-a9c1-a63db3032e77'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Delete snapshot completed successfully. Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2c6bb8e2-fe86-43e0-aeab-aa7b507adbb2 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-15103bfe-274a-42db-b0b0-238f0791c64b-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:56 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.574s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.478e73f4-a426-4a7c-9136-2a3863d30fb2o8476jw0.img {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:56 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.478e73f4-a426-4a7c-9136-2a3863d30fb2o8476jw0.img Sep 11 13:59:56 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "cinder-005ffe98-d511-4a0d-be6c-bfd0d25b76a2-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-005ffe98-d511-4a0d-be6c-bfd0d25b76a2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "cinder-quobyte-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-quobyte-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf61786e-e766-4101-8503-92ef5ca33588]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 13:59:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:56 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 Sep 11 13:59:56 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:57 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" returned: 0 in 0.732s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:57 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2 Sep 11 13:59:57 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:58 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" returned: 0 in 0.524s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-quobyte-005ffe98-d511-4a0d-be6c-bfd0d25b76a2" released by "delete_volume" :: held 1.377s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Created reservations ['160e8dba-2e8e-4aaf-86f3-17e7eb729274', '50e0e2c5-7a9d-4a8e-9793-ed0aa63235ee', '3f2db4f9-266c-4d02-8cff-a68e83384066', '46dbfe84-6e5c-4269-8578-a678ff0203fe'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 13:59:58 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 13:59:58 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 13:59:58 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.470s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 13:59:58 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 13:59:59 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Deleted volume successfully. Sep 11 13:59:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6542a0ed-4e2e-45cd-bf94-55005f4eb558 tempest-VolumesSnapshotNegativeTestJSON-778296051 None] Lock "cinder-005ffe98-d511-4a0d-be6c-bfd0d25b76a2-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:01 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.478e73f4-a426-4a7c-9136-2a3863d30fb2o8476jw0.img" returned: 0 in 5.129s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a2296f-36f6-4507-ba17-06770be4debb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:01 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 14:00:01 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.623s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:02 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.478e73f4-a426-4a7c-9136-2a3863d30fb2o8476jw0.img {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:00:02 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Converted 1024.00 MB image at 199.60 MB/s Sep 11 14:00:02 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:02 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] 478e73f4-a426-4a7c-9136-2a3863d30fb2 was raw, no need to convert to raw {{(pid=88731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Flow 'volume_create_manager' (4cb5bb5e-d557-4f9f-88a7-fb820140c19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33612cb8-09ba-4024-b2e4-7085afad3dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33612cb8-09ba-4024-b2e4-7085afad3dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa688bad-ae1b-4e40-9418-8a01c7ab0793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee63ef842044ddf8d6cba66d534553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:04Z,use_quota=True,user_id='582391fbe5fe4bb197366201ae12fa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cc6e59-c9c5-4a38-9ef2-175b59e657d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cc6e59-c9c5-4a38-9ef2-175b59e657d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceb3a26-5420-4786-9339-4e2b6f5543fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceb3a26-5420-4786-9339-4e2b6f5543fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa688bad-ae1b-4e40-9418-8a01c7ab0793', 'volume_name': 'volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5552305-80a7-4d29-ab63-ab231ee1fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5552305-80a7-4d29-ab63-ab231ee1fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc27e4d7-8621-4bfe-8173-d73a6bcc4f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Volume aa688bad-ae1b-4e40-9418-8a01c7ab0793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793', 'volume_size': 1} Sep 11 14:00:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:10 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:10 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:10 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:00:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Flow 'volume_create_manager' (32f1ddb4-f43d-4d3f-8d89-e4381bf064e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec197bdd-ec94-4cf2-99c8-6bfbd6bd1215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec197bdd-ec94-4cf2-99c8-6bfbd6bd1215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1285095951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76abfc-d124-45a1-b6d2-ed6299820193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f92c668a64d4de88cae5135c23fb503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:12Z,use_quota=True,user_id='aa54588076b04a969e28b71179a7eedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1160aa68-872a-4c78-b0e5-033b2f6fe3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1160aa68-872a-4c78-b0e5-033b2f6fe3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e929d2be-84cd-43b4-8392-714ca5e0e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e929d2be-84cd-43b4-8392-714ca5e0e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee76abfc-d124-45a1-b6d2-ed6299820193', 'volume_name': 'volume-ee76abfc-d124-45a1-b6d2-ed6299820193', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eed000-d45b-4a52-ad90-191e42646340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eed000-d45b-4a52-ad90-191e42646340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a18146a-2ad0-4051-8316-1df5e504e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:12 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Volume ee76abfc-d124-45a1-b6d2-ed6299820193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee76abfc-d124-45a1-b6d2-ed6299820193', 'volume_size': 1} Sep 11 14:00:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:22 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:00:22 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:DELETE=2,cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=5 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.184s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Uploaded volume to glance image-id: 478e73f4-a426-4a7c-9136-2a3863d30fb2. {{(pid=88731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.173s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa688bad-ae1b-4e40-9418-8a01c7ab0793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee63ef842044ddf8d6cba66d534553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:04Z,use_quota=True,user_id='582391fbe5fe4bb197366201ae12fa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Creating volume aa688bad-ae1b-4e40-9418-8a01c7ab0793 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:24 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:24 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 1073741824 Sep 11 14:00:24 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:24 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c6ab64a4-c436-40fd-bb95-f092118fca94 tempest-VolumesActionsTest-1295067300 None] Copy volume to image completed successfully. Sep 11 14:00:24 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 1073741824" returned: 0 in 0.471s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:24 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 Sep 11 14:00:25 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:25 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.962s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1285095951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76abfc-d124-45a1-b6d2-ed6299820193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f92c668a64d4de88cae5135c23fb503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:12Z,use_quota=True,user_id='aa54588076b04a969e28b71179a7eedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Creating volume ee76abfc-d124-45a1-b6d2-ed6299820193 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:25 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc27e4d7-8621-4bfe-8173-d73a6bcc4f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:25 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 1073741824 Sep 11 14:00:25 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a218848-5f23-4361-966b-b7caa05dddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Volume volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 (aa688bad-ae1b-4e40-9418-8a01c7ab0793): created successfully Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a218848-5f23-4361-966b-b7caa05dddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Flow 'volume_create_manager' (4cb5bb5e-d557-4f9f-88a7-fb820140c19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ef8256f6-2786-4130-805f-3e6d2a576fed tempest-CinderUnicodeTest-1167401964 None] Created volume successfully. Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:25 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 1073741824" returned: 0 in 0.413s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:25 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 Sep 11 14:00:25 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:25 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193" returned: 0 in 0.272s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.497s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a18146a-2ad0-4051-8316-1df5e504e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee76abfc-d124-45a1-b6d2-ed6299820193', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab137daf-5a9a-4248-b639-ea9d2b586986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcb386f-c0c7-4fc2-a49b-37e26bfd730a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Volume volume-ee76abfc-d124-45a1-b6d2-ed6299820193 (ee76abfc-d124-45a1-b6d2-ed6299820193): created successfully Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab137daf-5a9a-4248-b639-ea9d2b586986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Flow 'volume_create_manager' (32f1ddb4-f43d-4d3f-8d89-e4381bf064e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:26 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7952db3c-a665-41cd-ab1c-db5150ae3771 tempest-TestMinimumBasicScenario-993719291 None] Created volume successfully. Sep 11 14:00:26 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 14:00:26 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Flow 'volume_create_manager' (4d0dd240-dfb5-4696-a4b0-e67db5100332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef5fb20-df4a-40f7-9d6a-d77b2989a1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef5fb20-df4a-40f7-9d6a-d77b2989a1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1544920100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe0bbdf-4b15-4006-b1bd-00f614ad68c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee63ef842044ddf8d6cba66d534553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:26Z,use_quota=True,user_id='582391fbe5fe4bb197366201ae12fa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:26 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff488f6-c3ba-43b4-b8b7-a29522184e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff488f6-c3ba-43b4-b8b7-a29522184e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd2132b-85f5-4cd1-9753-f27161161318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd2132b-85f5-4cd1-9753-f27161161318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe0bbdf-4b15-4006-b1bd-00f614ad68c4', 'volume_name': 'volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00745ff-2ce2-4e43-b717-691cdbb232ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00745ff-2ce2-4e43-b717-691cdbb232ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf56fcc-d3f7-4eb4-aafd-b20021f3a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Volume ffe0bbdf-4b15-4006-b1bd-00f614ad68c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4', 'volume_size': 1} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344bcd3-0c12-4cf6-9414-672fe89800ad]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:26 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 14:00:26 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:26 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.354s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:26 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img Sep 11 14:00:26 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f78972ec-36f1-4c65-a2b4-3cb4fcec8319 req-2786fad3-34cc-4516-ae7c-3863ddef62d3 tempest-TestMinimumBasicScenario-993719291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:31 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img" returned: 0 in 4.860s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43f62f-f56a-465a-92b0-a010e559be14]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:31 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 14:00:31 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:32 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.538s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:00:32 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Converted 1024.00 MB image at 210.63 MB/s Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] 1787bc58-0103-4684-853b-cf76049b1d5e was raw, converting to qcow2 {{(pid=88731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41cf897-e848-4056-8eda-deedf1ea0fe1]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:32 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img Sep 11 14:00:32 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:32 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img" returned: 0 in 0.323s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:32 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img Sep 11 14:00:32 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:32 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img" returned: 1 in 0.329s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:00:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:32 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g Sep 11 14:00:32 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:33 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:33 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Image conversion details: src /opt/stack/data/cinder/conversion/8706e336-85a2-4d7f-ab35-4b3cb5ec2daf.temp_image.1787bc58-0103-4684-853b-cf76049b1d5ecy8ekeq8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:00:33 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 11 14:00:33 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f5a88-069b-40dc-b785-510a9ecf0861]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:33 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g Sep 11 14:00:33 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:33 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3pjizw7g" returned: 0 in 0.328s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.717s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Uploaded volume to glance image-id: 1787bc58-0103-4684-853b-cf76049b1d5e. {{(pid=88731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.270s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1544920100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe0bbdf-4b15-4006-b1bd-00f614ad68c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee63ef842044ddf8d6cba66d534553e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:26Z,use_quota=True,user_id='582391fbe5fe4bb197366201ae12fa11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Creating volume ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:34 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:34 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 1073741824 Sep 11 14:00:34 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a66789c0-c4aa-40d4-8ee8-51d321804a7b tempest-VolumesActionsTest-1295067300 None] Copy volume to image completed successfully. Sep 11 14:00:35 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 1073741824" returned: 0 in 0.459s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:35 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 Sep 11 14:00:35 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:35 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" returned: 0 in 0.241s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f78972ec-36f1-4c65-a2b4-3cb4fcec8319 req-2786fad3-34cc-4516-ae7c-3863ddef62d3 tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.768s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf56fcc-d3f7-4eb4-aafd-b20021f3a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986d5642-208e-436f-b0d7-500843be5e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f78972ec-36f1-4c65-a2b4-3cb4fcec8319 req-2786fad3-34cc-4516-ae7c-3863ddef62d3 tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:35 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Volume volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 (ffe0bbdf-4b15-4006-b1bd-00f614ad68c4): created successfully Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986d5642-208e-436f-b0d7-500843be5e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Flow 'volume_create_manager' (4d0dd240-dfb5-4696-a4b0-e67db5100332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d5f91d35-fab2-43e7-9139-7f4670312498 tempest-CinderUnicodeTest-1167401964 None] Created volume successfully. Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f78972ec-36f1-4c65-a2b4-3cb4fcec8319 req-2786fad3-34cc-4516-ae7c-3863ddef62d3 tempest-TestMinimumBasicScenario-993719291 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-ee76abfc-d124-45a1-b6d2-ed6299820193', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a27604f-4109-471a-941d-97d0b450fefb', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:00:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f78972ec-36f1-4c65-a2b4-3cb4fcec8319 req-2786fad3-34cc-4516-ae7c-3863ddef62d3 tempest-TestMinimumBasicScenario-993719291 None] attachment_update completed successfully. Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Acquiring lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Acquiring lock "cinder-quobyte-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Lock "cinder-quobyte-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38aaaf3-07d7-4585-8d9f-2efe2bcb16a8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:35 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 14:00:35 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:36 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.415s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:36 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf Sep 11 14:00:36 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:36 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Lock "cinder-quobyte-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf" released by "delete_volume" :: held 0.754s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Creating offline snapshot 28e6efff-4d26-4d01-974d-acadf75b586d of volume ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb32584-062b-4fc8-887e-a433fac368ad]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Created reservations ['a695fa7f-5b0e-44f4-af50-cef2d5565bf9', 'dc317075-ad9a-4ee9-922b-1646cfeaab5c', '0ef4b32b-7d46-4dcc-9ca1-79c15e46c740', '3d6be40f-bccd-445a-8b37-6725d79cd2b4'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:36 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 Sep 11 14:00:36 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:36 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:36 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:36 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.289s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Deleted volume successfully. Sep 11 14:00:36 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" returned: 0 in 0.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2ba26641-a707-4d3f-a303-61230d8fbf9a tempest-VolumesActionsTest-1295067300 None] Lock "cinder-8706e336-85a2-4d7f-ab35-4b3cb5ec2daf-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:37 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d 1G Sep 11 14:00:37 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:37 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d 1G" returned: 0 in 0.465s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:37 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d Sep 11 14:00:37 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:37 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d" returned: 0 in 0.296s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d is being set with open permissions: ugo+rw Sep 11 14:00:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:37 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d Sep 11 14:00:37 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:38 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:38 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info Sep 11 14:00:38 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:38 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:38 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info is being set with open permissions: ugo+rw Sep 11 14:00:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:38 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info Sep 11 14:00:38 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:38 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.info" returned: 0 in 0.289s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ec424087-952d-44c8-8351-8b4d1db2b1a2 tempest-CinderUnicodeTest-1167401964 None] Create snapshot completed successfully Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-28e6efff-4d26-4d01-974d-acadf75b586d-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-28e6efff-4d26-4d01-974d-acadf75b586d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-quobyte-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-quobyte-28e6efff-4d26-4d01-974d-acadf75b586d" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-28e6efff-4d26-4d01-974d-acadf75b586d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Deleting offline snapshot 28e6efff-4d26-4d01-974d-acadf75b586d of volume ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] snapshot_file for this snap is: volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a0c47-7c8a-4485-9683-a80223d1ff9a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:39 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d Sep 11 14:00:39 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:40 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d" returned: 0 in 0.397s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:00:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdc94c-580f-41cb-823a-09f349113180]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:40 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 Sep 11 14:00:40 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:40 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" returned: 0 in 0.455s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:40 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d Sep 11 14:00:40 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:41 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d" returned: 0 in 0.387s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:41 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d Sep 11 14:00:41 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:41 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4.28e6efff-4d26-4d01-974d-acadf75b586d" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-28e6efff-4d26-4d01-974d-acadf75b586d" released by "_delete_snapshot" :: held 1.663s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" released by "delete_snapshot" :: held 1.693s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Created reservations ['82a260c1-0b4e-476c-94b4-714bc8a093c5', 'aec1e5f4-9e9a-4751-86ed-94ee26d24e1c', 'e66e6e54-2160-4845-bd1f-2f0acb597b99', '7d9719d5-a92d-42c9-a3b7-056714082c2a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Delete snapshot completed successfully. Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca7d57d1-4399-469a-86e4-5d0879ea2d62 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-28e6efff-4d26-4d01-974d-acadf75b586d-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-quobyte-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9db9d15-1754-41a4-873b-932fec408f0b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:42 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 Sep 11 14:00:42 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:42 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" returned: 0 in 0.404s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:42 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4 Sep 11 14:00:42 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:42 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" returned: 0 in 0.293s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4" released by "delete_volume" :: held 0.768s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:42 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Created reservations ['2f54e800-ac46-415e-b779-25ac6f1d9a22', 'c1629513-fc50-4d32-a1c3-190581441d44', 'e2d01440-cf7c-4e4d-96f6-035e3081d70e', 'f5bf35dc-9f1e-488a-87dd-dd5c4c270846'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:43 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:43 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-aa688bad-ae1b-4e40-9418-8a01c7ab0793-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-aa688bad-ae1b-4e40-9418-8a01c7ab0793-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "cinder-quobyte-aa688bad-ae1b-4e40-9418-8a01c7ab0793" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-aa688bad-ae1b-4e40-9418-8a01c7ab0793" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:43 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Deleted volume successfully. Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca95005-ac27-42f3-a140-de9c09b6f170]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-63d1e57d-525f-4f61-bb76-f4c0571ffb2f tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-ffe0bbdf-4b15-4006-b1bd-00f614ad68c4-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:43 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 Sep 11 14:00:43 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:43 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793" returned: 0 in 0.542s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:43 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793 Sep 11 14:00:43 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:44 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aa688bad-ae1b-4e40-9418-8a01c7ab0793" returned: 0 in 0.338s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-quobyte-aa688bad-ae1b-4e40-9418-8a01c7ab0793" released by "delete_volume" :: held 0.948s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Created reservations ['ae0aef67-1d0f-4f19-9904-90f58dbd8676', 'bc09aa5f-0467-42a2-8e08-759f2610e187', '9f58dc16-3e28-444e-842c-f9ea7e8279ca', '4b590399-0845-4dab-8f66-3a3b988ac7ab'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:44 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:44 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:44 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Deleted volume successfully. Sep 11 14:00:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-531f096f-28e5-4cf7-9761-2d9617c43f91 tempest-CinderUnicodeTest-1167401964 None] Lock "cinder-aa688bad-ae1b-4e40-9418-8a01c7ab0793-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (6efdeb33-f651-44c9-9a7f-0cb9118e4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8a350e-56b9-47a4-9097-f62942eb4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8a350e-56b9-47a4-9097-f62942eb4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062202665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9fd62-dc39-4b52-8cf5-e75126ee8196,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:45Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fecf881-1b50-4f6c-b6c6-2ec5fb4eb74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fecf881-1b50-4f6c-b6c6-2ec5fb4eb74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d52ece-8a35-4a56-8135-257221eb73a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d52ece-8a35-4a56-8135-257221eb73a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca9fd62-dc39-4b52-8cf5-e75126ee8196', 'volume_name': 'volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecbaedd-ac9f-499f-bbb8-44ad328d8071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecbaedd-ac9f-499f-bbb8-44ad328d8071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed79f8d0-d43d-4bb2-aabe-da6a7a4ceacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:45 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Volume 6ca9fd62-dc39-4b52-8cf5-e75126ee8196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196', 'volume_size': 1} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062202665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9fd62-dc39-4b52-8cf5-e75126ee8196,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:45Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Creating volume 6ca9fd62-dc39-4b52-8cf5-e75126ee8196 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:45 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:45 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 1073741824 Sep 11 14:00:45 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:46 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 1073741824" returned: 0 in 0.436s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:46 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 Sep 11 14:00:46 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:46 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed79f8d0-d43d-4bb2-aabe-da6a7a4ceacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfde4b91-a61a-462a-b483-d7e362029110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:46 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Volume volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 (6ca9fd62-dc39-4b52-8cf5-e75126ee8196): created successfully Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfde4b91-a61a-462a-b483-d7e362029110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (6efdeb33-f651-44c9-9a7f-0cb9118e4214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4c140da2-f1e4-4496-9339-85546f4800e5 tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (3239b967-0718-4b38-8705-4dad7bbe3cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d57e36-9da6-4fde-848a-8e692655f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d57e36-9da6-4fde-848a-8e692655f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-753967603',display_name='tempest-VolumesGetTest-Volume-222048240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826f5721-9091-4c94-817d-046e0cee22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:47Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84b02ef-77dd-423f-ac6c-a2f317b713c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84b02ef-77dd-423f-ac6c-a2f317b713c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07552d6-4079-439e-8ea7-c90dff220f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07552d6-4079-439e-8ea7-c90dff220f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826f5721-9091-4c94-817d-046e0cee22f3', 'volume_name': 'volume-826f5721-9091-4c94-817d-046e0cee22f3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6372bd83-7ca5-48a4-aaa9-eb25acc6710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6372bd83-7ca5-48a4-aaa9-eb25acc6710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2fc34d5-c015-403d-b4d1-f288f008b568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:47 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Volume 826f5721-9091-4c94-817d-046e0cee22f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826f5721-9091-4c94-817d-046e0cee22f3', 'volume_size': 1} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-753967603',display_name='tempest-VolumesGetTest-Volume-222048240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826f5721-9091-4c94-817d-046e0cee22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:47Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Creating volume 826f5721-9091-4c94-817d-046e0cee22f3 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:47 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:47 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 1073741824 Sep 11 14:00:47 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:47 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 1073741824" returned: 0 in 0.467s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:48 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 Sep 11 14:00:48 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:48 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2fc34d5-c015-403d-b4d1-f288f008b568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826f5721-9091-4c94-817d-046e0cee22f3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a736a8-347d-4e86-bac7-73a5835ce182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Volume volume-826f5721-9091-4c94-817d-046e0cee22f3 (826f5721-9091-4c94-817d-046e0cee22f3): created successfully Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a736a8-347d-4e86-bac7-73a5835ce182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (3239b967-0718-4b38-8705-4dad7bbe3cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-329b31bf-ff0e-4e65-b6d3-20512ed01c65 tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-826f5721-9091-4c94-817d-046e0cee22f3-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Lock "cinder-826f5721-9091-4c94-817d-046e0cee22f3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-826f5721-9091-4c94-817d-046e0cee22f3" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-826f5721-9091-4c94-817d-046e0cee22f3" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa6e832-7074-4932-9239-8de310d2485b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:48 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 Sep 11 14:00:48 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:49 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3" returned: 0 in 0.396s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:49 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3 Sep 11 14:00:49 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Flow 'volume_create_manager' (a92d6fdc-0b89-4fba-a022-caa1bce1d884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a35d1ac-a74e-4deb-b300-38f59cf2f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a35d1ac-a74e-4deb-b300-38f59cf2f95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990823557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff238713-c69c-4015-82fc-e6edd361e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5168fab86b94109ba9a672bfd4cc57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:49Z,use_quota=True,user_id='efef5f56c3624524a06ca280d0189b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7ffbe8-8379-4c83-9a13-5960a26da399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7ffbe8-8379-4c83-9a13-5960a26da399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5841d9af-c526-46ba-97a6-122f3b001a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5841d9af-c526-46ba-97a6-122f3b001a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff238713-c69c-4015-82fc-e6edd361e385', 'volume_name': 'volume-ff238713-c69c-4015-82fc-e6edd361e385', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38e3d4-8668-4c4e-af69-2aae2b4bf6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff38e3d4-8668-4c4e-af69-2aae2b4bf6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee73f6b3-9d52-4884-80b2-1d5c2e98d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Volume ff238713-c69c-4015-82fc-e6edd361e385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff238713-c69c-4015-82fc-e6edd361e385', 'volume_size': 1} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990823557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff238713-c69c-4015-82fc-e6edd361e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5168fab86b94109ba9a672bfd4cc57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:49Z,use_quota=True,user_id='efef5f56c3624524a06ca280d0189b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Creating volume ff238713-c69c-4015-82fc-e6edd361e385 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:49 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:49 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 1073741824 Sep 11 14:00:49 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:49 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-826f5721-9091-4c94-817d-046e0cee22f3" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-826f5721-9091-4c94-817d-046e0cee22f3" released by "delete_volume" :: held 0.718s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Created reservations ['414ccaa4-675e-474c-b3b9-220089ae14a6', '1b3b9fd7-7c18-4097-ab9e-5a4459eca34f', '3928223f-e2d8-446c-83f5-ddeffd7c0c43', 'b26f1920-b6df-4d52-8c4b-ab51d906aa68'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:49 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:49 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:49 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 1073741824" returned: 0 in 0.455s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:49 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 Sep 11 14:00:49 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:49 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.279s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-50df56b9-c6c4-4cd2-88a7-4d601e4a8707 tempest-VolumesGetTest-372848608 None] Lock "cinder-826f5721-9091-4c94-817d-046e0cee22f3-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-6ca9fd62-dc39-4b52-8cf5-e75126ee8196-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Lock "cinder-6ca9fd62-dc39-4b52-8cf5-e75126ee8196-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-6ca9fd62-dc39-4b52-8cf5-e75126ee8196" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-6ca9fd62-dc39-4b52-8cf5-e75126ee8196" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72238d1-0df9-4ade-83f2-80a088082fde]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:50 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385" returned: 0 in 0.266s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee73f6b3-9d52-4884-80b2-1d5c2e98d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff238713-c69c-4015-82fc-e6edd361e385', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ccc627-7a6e-4d76-96eb-c3cf54b97af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:50 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Volume volume-ff238713-c69c-4015-82fc-e6edd361e385 (ff238713-c69c-4015-82fc-e6edd361e385): created successfully Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ccc627-7a6e-4d76-96eb-c3cf54b97af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Flow 'volume_create_manager' (a92d6fdc-0b89-4fba-a022-caa1bce1d884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:50 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 Sep 11 14:00:50 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-82311d96-4592-46b6-a77d-6f2bdffd5ea1 tempest-ProjectReaderTests-1319315474 None] Created volume successfully. Sep 11 14:00:50 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:50 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196 Sep 11 14:00:50 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:50 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6ca9fd62-dc39-4b52-8cf5-e75126ee8196" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-6ca9fd62-dc39-4b52-8cf5-e75126ee8196" released by "delete_volume" :: held 0.652s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Created reservations ['f55c4957-821e-41e6-9be4-1f61250aa91b', 'cd92f801-c908-46ce-a437-7a3afc11f2b4', 'd16a170b-9deb-46da-9699-23017ffaae79', '6937ce4f-70d0-4c76-a7f4-6e264c0b1eee'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:50 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:50 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:50 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:00:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a26258fb-0e76-440a-b5d8-18a779af84b1 tempest-VolumesGetTest-372848608 None] Lock "cinder-6ca9fd62-dc39-4b52-8cf5-e75126ee8196-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Acquiring lock "cinder-ff238713-c69c-4015-82fc-e6edd361e385-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Lock "cinder-ff238713-c69c-4015-82fc-e6edd361e385-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Acquiring lock "cinder-quobyte-ff238713-c69c-4015-82fc-e6edd361e385" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Lock "cinder-quobyte-ff238713-c69c-4015-82fc-e6edd361e385" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47144385-3daa-4d8a-9245-83966a872605]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (5360b109-9116-42e8-9e70-f6a4cbdfe351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a97e224-baca-43c2-a413-78d89ab622d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a97e224-baca-43c2-a413-78d89ab622d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1533099585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78b24af-37ad-4c04-8488-6aba5f6090da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:51Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9399e12d-0286-4aa4-97ef-4d93161ede74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9399e12d-0286-4aa4-97ef-4d93161ede74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4efd20-7f2c-4da2-b9ce-e2aa77ea3fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4efd20-7f2c-4da2-b9ce-e2aa77ea3fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78b24af-37ad-4c04-8488-6aba5f6090da', 'volume_name': 'volume-c78b24af-37ad-4c04-8488-6aba5f6090da', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f1da9e-34e5-458b-ac7b-b4aa512aea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f1da9e-34e5-458b-ac7b-b4aa512aea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ccbdb-7e55-48c1-83f4-4bff058ef88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:51 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Volume c78b24af-37ad-4c04-8488-6aba5f6090da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78b24af-37ad-4c04-8488-6aba5f6090da', 'volume_size': 1} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1533099585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78b24af-37ad-4c04-8488-6aba5f6090da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:51Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Creating volume c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:51 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:51 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 Sep 11 14:00:51 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:51 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da 1073741824 Sep 11 14:00:51 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:51 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385" returned: 0 in 0.365s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:51 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385 Sep 11 14:00:51 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:52 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da 1073741824" returned: 0 in 0.428s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:52 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da Sep 11 14:00:52 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:52 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ff238713-c69c-4015-82fc-e6edd361e385" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Lock "cinder-quobyte-ff238713-c69c-4015-82fc-e6edd361e385" released by "delete_volume" :: held 0.659s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Created reservations ['692e3d24-99df-441d-a22a-6167836272c2', 'c2032496-4050-4714-9df5-dee5cf5b3d49', 'b9d8257f-e5a2-4e54-b6a1-9ec513917ab6', '8fbc0163-aead-4e3a-a652-02ce8f8b9251'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:52 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:52 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:52 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ccbdb-7e55-48c1-83f4-4bff058ef88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78b24af-37ad-4c04-8488-6aba5f6090da', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3503bdec-3bf0-45a0-9a8f-cff53bb56a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:52 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Volume volume-c78b24af-37ad-4c04-8488-6aba5f6090da (c78b24af-37ad-4c04-8488-6aba5f6090da): created successfully Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3503bdec-3bf0-45a0-9a8f-cff53bb56a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (5360b109-9116-42e8-9e70-f6a4cbdfe351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:52 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-066fe2d1-549d-4d36-ab4d-6c663a4d0775 tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:00:52 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.252s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:52 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Deleted volume successfully. Sep 11 14:00:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3dd7b77e-a99e-44e0-8891-66490a7672ce tempest-ProjectReaderTests-1319315474 None] Lock "cinder-ff238713-c69c-4015-82fc-e6edd361e385-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Flow 'volume_create_manager' (bda8ccc7-9098-477a-a231-212fa0f9f169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66ffa4d-79f1-465c-95bf-4677221d676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (6ffef1ab-8939-4c02-8ee8-e6bb93f4aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e30e10-9579-4303-ac23-a1e240c81171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66ffa4d-79f1-465c-95bf-4677221d676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074196434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96a0c7c-4c1d-4001-b359-0b0643cbdcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5168fab86b94109ba9a672bfd4cc57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:53Z,use_quota=True,user_id='efef5f56c3624524a06ca280d0189b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83aef84c-5dc8-418a-8476-a88d90c6a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83aef84c-5dc8-418a-8476-a88d90c6a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2d4d9c-ba6c-4214-80f5-b68d07c74f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2d4d9c-ba6c-4214-80f5-b68d07c74f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96a0c7c-4c1d-4001-b359-0b0643cbdcca', 'volume_name': 'volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2217a30-0d72-4c90-b742-f6cbf176b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2217a30-0d72-4c90-b742-f6cbf176b125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faded595-cc48-42cd-9eac-56a4dbfcabbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Volume a96a0c7c-4c1d-4001-b359-0b0643cbdcca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca', 'volume_size': 1} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074196434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96a0c7c-4c1d-4001-b359-0b0643cbdcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5168fab86b94109ba9a672bfd4cc57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:53Z,use_quota=True,user_id='efef5f56c3624524a06ca280d0189b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Creating volume a96a0c7c-4c1d-4001-b359-0b0643cbdcca {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:00:53 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:53 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca 1073741824 Sep 11 14:00:53 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e30e10-9579-4303-ac23-a1e240c81171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-471006673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89e62c8-da9f-4fbc-a6af-48f5781af9c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c78b24af-37ad-4c04-8488-6aba5f6090da,status='creating',terminated_at=None,updated_at=2026-09-11T12:00:53Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad54bcc-3de9-429c-9c6b-9ba25685c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad54bcc-3de9-429c-9c6b-9ba25685c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e280b002-acfc-4afb-8ad9-53604ad9f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e280b002-acfc-4afb-8ad9-53604ad9f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c89e62c8-da9f-4fbc-a6af-48f5781af9c0', 'volume_name': 'volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0', 'volume_size': 1, 'source_volid': 'c78b24af-37ad-4c04-8488-6aba5f6090da', 'source_volstatus': 'available'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f45325-8d82-493a-bc66-9d9bcc60b267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f45325-8d82-493a-bc66-9d9bcc60b267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5bf756-8ba5-48d6-86f2-b931127a4782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Volume c89e62c8-da9f-4fbc-a6af-48f5781af9c0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0', 'volume_size': 1, 'source_volid': 'c78b24af-37ad-4c04-8488-6aba5f6090da', 'source_volstatus': 'available'} Sep 11 14:00:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:54 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca 1073741824" returned: 0 in 0.414s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:54 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca Sep 11 14:00:54 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:54 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.563s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:54 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Cloning volume c78b24af-37ad-4c04-8488-6aba5f6090da to volume c89e62c8-da9f-4fbc-a6af-48f5781af9c0 Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faded595-cc48-42cd-9eac-56a4dbfcabbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d598e21-cdc5-4bbd-b519-80c7df3c631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:00:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Volume volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca (a96a0c7c-4c1d-4001-b359-0b0643cbdcca): created successfully Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d598e21-cdc5-4bbd-b519-80c7df3c631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Flow 'volume_create_manager' (bda8ccc7-9098-477a-a231-212fa0f9f169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Creating offline snapshot 24ad124c-5c4c-4109-8115-51836bf156a7 of volume c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:00:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d2539a78-610e-463a-a90f-ae3d7b255f6b tempest-ProjectReaderTests-1319315474 None] Created volume successfully. Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00b6d9-01a9-43e9-92bd-fbd208cc1abd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:54 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da Sep 11 14:00:54 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:54 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:54 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 1G Sep 11 14:00:54 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:55 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 1G" returned: 0 in 0.411s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78b24af-37ad-4c04-8488-6aba5f6090da -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:55 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78b24af-37ad-4c04-8488-6aba5f6090da -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 Sep 11 14:00:55 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Acquiring lock "cinder-a96a0c7c-4c1d-4001-b359-0b0643cbdcca-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Lock "cinder-a96a0c7c-4c1d-4001-b359-0b0643cbdcca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Acquiring lock "cinder-quobyte-a96a0c7c-4c1d-4001-b359-0b0643cbdcca" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Lock "cinder-quobyte-a96a0c7c-4c1d-4001-b359-0b0643cbdcca" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc929cb9-d1fd-4b23-ad4e-71fdaf2da99f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:55 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca Sep 11 14:00:55 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:55 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78b24af-37ad-4c04-8488-6aba5f6090da -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7" returned: 0 in 0.312s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:55 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 is being set with open permissions: ugo+rw Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:55 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 Sep 11 14:00:55 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:55 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca" returned: 0 in 0.370s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:55 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca Sep 11 14:00:55 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:55 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:55 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info Sep 11 14:00:55 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:55 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a96a0c7c-4c1d-4001-b359-0b0643cbdcca" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Lock "cinder-quobyte-a96a0c7c-4c1d-4001-b359-0b0643cbdcca" released by "delete_volume" :: held 0.686s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:56 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Created reservations ['7b757410-29eb-4e68-aee6-e83e02657523', 'c9e56beb-8d6a-4eaf-a374-4f3ab98ffd34', 'a2019e39-f39f-4b7e-aa3f-689e144c6ef9', '59108ef4-bfb5-4b76-9ad2-da139146d73b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info" returned: 0 in 0.254s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:56 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info is being set with open permissions: ugo+rw Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:56 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info Sep 11 14:00:56 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:56 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:00:56 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:56 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.info" returned: 0 in 0.304s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] snapshot: 24ad124c-5c4c-4109-8115-51836bf156a7, volume: c89e62c8-da9f-4fbc-a6af-48f5781af9c0, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[131a2561-3a4a-4952-b763-312df432838b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:56 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.300s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:00:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Deleted volume successfully. Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c253a3a1-0446-4231-aba5-26eee83206d0 tempest-ProjectReaderTests-1319315474 None] Lock "cinder-a96a0c7c-4c1d-4001-b359-0b0643cbdcca-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:00:56 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 Sep 11 14:00:56 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:56 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7" returned: 0 in 0.473s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78b24af-37ad-4c04-8488-6aba5f6090da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c97d51e-98d6-4e14-a9f6-f995fa974a8e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:00:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:57 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da Sep 11 14:00:57 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:00:57 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 11 14:00:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da" returned: 0 in 0.397s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:00:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 14:00:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 14:00:57 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 14:00:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:00:57 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 Sep 11 14:00:57 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:03 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" returned: 0 in 6.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:03 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:01:03 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Converted 1024.00 MB image at 160.86 MB/s Sep 11 14:01:03 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 is being set with open permissions: ugo+rw Sep 11 14:01:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:03 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 Sep 11 14:01:03 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:04 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" released by "_copy_volume_from_snapshot" :: held 7.622s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-24ad124c-5c4c-4109-8115-51836bf156a7" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-24ad124c-5c4c-4109-8115-51836bf156a7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Deleting offline snapshot 24ad124c-5c4c-4109-8115-51836bf156a7 of volume c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] snapshot_file for this snap is: volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf20749-3eda-46f0-b5dd-faf9c23cdebf]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:04 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 Sep 11 14:01:04 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:04 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7" returned: 0 in 0.396s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78b24af-37ad-4c04-8488-6aba5f6090da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d35d157-a8f4-4999-a006-c042e50c52dc]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:04 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da Sep 11 14:01:04 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:05 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da" returned: 0 in 0.633s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:05 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 Sep 11 14:01:05 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:05 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:05 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7 Sep 11 14:01:05 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:05 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da.24ad124c-5c4c-4109-8115-51836bf156a7" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-24ad124c-5c4c-4109-8115-51836bf156a7" released by "_delete_snapshot" :: held 1.779s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.573s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5bf756-8ba5-48d6-86f2-b931127a4782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0', 'volume_size': 1, 'source_volid': 'c78b24af-37ad-4c04-8488-6aba5f6090da', 'source_volstatus': 'available'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee70e94-c9c8-4c9d-ad5f-fc64b6a45060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Volume volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 (c89e62c8-da9f-4fbc-a6af-48f5781af9c0): created successfully Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee70e94-c9c8-4c9d-ad5f-fc64b6a45060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (6ffef1ab-8939-4c02-8ee8-e6bb93f4aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:06 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f5809be8-7d57-4bae-9484-17dc36c8124b tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (fd09d34c-9b6c-4872-b77f-e9896a2d9b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb8321f-8154-4852-b827-d8d1660f7b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb8321f-8154-4852-b827-d8d1660f7b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1356942986',display_name='tempest-VolumesGetTest-Volume-79883972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:07Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e926d292-2ca1-4da3-a575-6e7b32079a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e926d292-2ca1-4da3-a575-6e7b32079a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01d023b-e656-449e-a9d2-0a3b12241898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01d023b-e656-449e-a9d2-0a3b12241898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4', 'volume_name': 'volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebf047d-3498-45a6-be9e-116a5ee88e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebf047d-3498-45a6-be9e-116a5ee88e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ad695d-a3ee-486e-b76f-e3919e855917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Volume 35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4', 'volume_size': 1} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1356942986',display_name='tempest-VolumesGetTest-Volume-79883972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:07Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Creating volume 35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:01:07 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:07 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 1073741824 Sep 11 14:01:07 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:07 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 1073741824" returned: 0 in 0.403s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:07 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 Sep 11 14:01:07 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:08 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ad695d-a3ee-486e-b76f-e3919e855917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c083b434-312a-4b5c-a213-f5a7385c80ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Volume volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 (35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4): created successfully Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c083b434-312a-4b5c-a213-f5a7385c80ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (fd09d34c-9b6c-4872-b77f-e9896a2d9b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bb6717cc-7be4-45b0-967d-80a8ccc88f54 tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Lock "cinder-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99d468d-6bbe-4f80-b505-661abb2fb816]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:08 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 Sep 11 14:01:08 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:08 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4" returned: 0 in 0.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:08 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4 Sep 11 14:01:08 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:09 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4" released by "delete_volume" :: held 0.645s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Created reservations ['55dc07bd-1e3d-4a41-9718-274d92710e77', 'c7759467-cd25-40f7-b117-90b250d548d7', 'cf5a0275-bca2-47b2-a581-9e4582fe8bac', 'f4fdf5d5-8049-40e1-b56f-6f983a68c743'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:09 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:09 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:09 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b398688-a5e8-44e8-b3fc-dfe9f9e82d8e tempest-VolumesGetTest-372848608 None] Lock "cinder-35a80aec-13e2-400a-ba6e-ebc2f2a7c3e4-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-c89e62c8-da9f-4fbc-a6af-48f5781af9c0-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Lock "cinder-c89e62c8-da9f-4fbc-a6af-48f5781af9c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23704f-e067-4d30-b101-fb76b18f051b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:09 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 Sep 11 14:01:09 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:10 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" returned: 0 in 0.370s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:10 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0 Sep 11 14:01:10 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:10 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-c89e62c8-da9f-4fbc-a6af-48f5781af9c0" released by "delete_volume" :: held 0.677s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Created reservations ['d212afd4-1002-480b-84e5-384ba1493ebc', 'f99bb81e-bcbe-4a29-9977-1238bd18c32a', '24b10819-1a71-48d2-ac79-9cf2c755af7a', '0d87d995-1741-48ee-936b-4c444057b12f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:01:10 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:10 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:10 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:10 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:10 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:01:10 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c08b3e76-fb3b-4e6e-bea4-3c36b1a5cb34 tempest-VolumesGetTest-372848608 None] Lock "cinder-c89e62c8-da9f-4fbc-a6af-48f5781af9c0-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-c78b24af-37ad-4c04-8488-6aba5f6090da-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Lock "cinder-c78b24af-37ad-4c04-8488-6aba5f6090da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-c78b24af-37ad-4c04-8488-6aba5f6090da" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-c78b24af-37ad-4c04-8488-6aba5f6090da" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdd22e8-e43c-40ab-a837-9d5d83156964]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:11 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da Sep 11 14:01:11 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:11 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da" returned: 0 in 0.351s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:11 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da Sep 11 14:01:11 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:11 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c78b24af-37ad-4c04-8488-6aba5f6090da" returned: 0 in 0.231s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-c78b24af-37ad-4c04-8488-6aba5f6090da" released by "delete_volume" :: held 0.635s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Created reservations ['6d5a1c6f-37ba-42a3-a051-77492bf6154e', '3a073a30-aff3-4b5f-a410-028378c0ccf2', 'fbeafb0d-2a77-4fd9-9006-dfa0011f848d', 'a2c0e134-7f39-4f55-ba72-0c5bee1e2b4c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:11 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:11 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:12 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.243s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bbb5f308-16b4-4eda-a023-5f9a3ef950e0 tempest-VolumesGetTest-372848608 None] Lock "cinder-c78b24af-37ad-4c04-8488-6aba5f6090da-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (e599f34b-9b7c-4818-9fc8-76e2a6b3c9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7702132f-1c57-40bf-91b3-b3cd4aff4aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7702132f-1c57-40bf-91b3-b3cd4aff4aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1944727407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117fd314-acd0-41b5-a48d-6e01043d7f37,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:13Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8536b81-e36a-4fdf-8a93-0016b2f131b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8536b81-e36a-4fdf-8a93-0016b2f131b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44024155-36cf-422a-8d0d-70eedf05f77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:12 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44024155-36cf-422a-8d0d-70eedf05f77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '117fd314-acd0-41b5-a48d-6e01043d7f37', 'volume_name': 'volume-117fd314-acd0-41b5-a48d-6e01043d7f37', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8aac32-83a9-46bc-8e6b-aaf598ccda30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8aac32-83a9-46bc-8e6b-aaf598ccda30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a26564-6e28-43b3-b9e5-bc0e8be77192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:13 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Volume 117fd314-acd0-41b5-a48d-6e01043d7f37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-117fd314-acd0-41b5-a48d-6e01043d7f37', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Trying to clone 117fd314-acd0-41b5-a48d-6e01043d7f37 from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 14:01:13 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Image download 20.69 MB at 20.69 MB/s Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0090316-5a32-4b84-8387-793932454e54]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:13 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD Sep 11 14:01:13 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:13 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c is fetched for user 0769b61e24244f86b1f3fa259490998d. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fced87d-d012-4bbe-b7aa-fe6f0f87d56b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:13 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD Sep 11 14:01:13 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:14 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1944727407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117fd314-acd0-41b5-a48d-6e01043d7f37,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:13Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Creating volume 117fd314-acd0-41b5-a48d-6e01043d7f37 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:01:14 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:14 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 1073741824 Sep 11 14:01:14 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:14 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 1073741824" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:14 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 Sep 11 14:01:14 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:14 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:14 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Attempting download of 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 117fd314-acd0-41b5-a48d-6e01043d7f37. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c060ea-7275-416c-bbf4-f4c7c518fa3b]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:15 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e Sep 11 14:01:15 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:15 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e" returned: 0 in 0.323s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:15 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e Sep 11 14:01:15 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:15 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e" returned: 1 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_0n686e0e' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c9b5e-e05c-4279-9809-d7defed3ae73]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:15 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD Sep 11 14:01:15 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:15 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] 6b854647-c6a5-4221-a6fc-d6c3dbc5707c was qcow2, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 14:01:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:16 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 Sep 11 14:01:16 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:17 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37" returned: 0 in 1.734s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:17 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_l2899s_udevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:01:17 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Converted 112.00 MB image at 64.56 MB/s Sep 11 14:01:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:17 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 1G Sep 11 14:01:17 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:18 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 1G" returned: 0 in 0.315s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Downloaded image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 117fd314-acd0-41b5-a48d-6e01043d7f37 successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c for user 0769b61e24244f86b1f3fa259490998d is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Marking volume 117fd314-acd0-41b5-a48d-6e01043d7f37 as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Copying metadata from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c to 117fd314-acd0-41b5-a48d-6e01043d7f37. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Creating volume glance metadata for volume 117fd314-acd0-41b5-a48d-6e01043d7f37 backed by image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a26564-6e28-43b3-b9e5-bc0e8be77192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117fd314-acd0-41b5-a48d-6e01043d7f37', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7137952e-033a-46a0-9e3d-f83074650d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:18 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Volume volume-117fd314-acd0-41b5-a48d-6e01043d7f37 (117fd314-acd0-41b5-a48d-6e01043d7f37): created successfully Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7137952e-033a-46a0-9e3d-f83074650d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (e599f34b-9b7c-4818-9fc8-76e2a6b3c9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ac18e2aa-5125-46e5-bafc-a79c43fbad58 tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (5ae65ec6-2d7a-4e55-8918-4d44d6cdb020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9d03bb-daab-4fc1-87b2-1dc11673ce6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9d03bb-daab-4fc1-87b2-1dc11673ce6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-13791839',display_name='tempest-VolumesGetTest-Volume-762510499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa054469-8cbe-4462-9456-3152b0ffb396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:20Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414eabf0-a318-4349-84a6-721431baf4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414eabf0-a318-4349-84a6-721431baf4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719a984d-6807-4c4e-908c-04acb9ab346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719a984d-6807-4c4e-908c-04acb9ab346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa054469-8cbe-4462-9456-3152b0ffb396', 'volume_name': 'volume-fa054469-8cbe-4462-9456-3152b0ffb396', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59526f9c-7eca-4471-903b-5ead6ff72a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59526f9c-7eca-4471-903b-5ead6ff72a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8619ba2-9dcc-450d-b1ba-eb6f7b026b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:19 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Volume fa054469-8cbe-4462-9456-3152b0ffb396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa054469-8cbe-4462-9456-3152b0ffb396', 'volume_size': 1} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-13791839',display_name='tempest-VolumesGetTest-Volume-762510499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa054469-8cbe-4462-9456-3152b0ffb396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb373b62d3a40bf98b383c88fac6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:20Z,use_quota=True,user_id='0769b61e24244f86b1f3fa259490998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Creating volume fa054469-8cbe-4462-9456-3152b0ffb396 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:01:19 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:01:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:19 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 1073741824 Sep 11 14:01:19 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:20 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 1073741824" returned: 0 in 0.465s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:20 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 Sep 11 14:01:20 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:20 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396" returned: 0 in 0.266s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8619ba2-9dcc-450d-b1ba-eb6f7b026b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa054469-8cbe-4462-9456-3152b0ffb396', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9742ff24-df26-4f25-92cf-ccba011bbd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:20 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Volume volume-fa054469-8cbe-4462-9456-3152b0ffb396 (fa054469-8cbe-4462-9456-3152b0ffb396): created successfully Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9742ff24-df26-4f25-92cf-ccba011bbd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Flow 'volume_create_manager' (5ae65ec6-2d7a-4e55-8918-4d44d6cdb020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f1fdbde1-1b23-49de-8ca4-97183f1bb5f3 tempest-VolumesGetTest-372848608 None] Created volume successfully. Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-fa054469-8cbe-4462-9456-3152b0ffb396-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Lock "cinder-fa054469-8cbe-4462-9456-3152b0ffb396-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-fa054469-8cbe-4462-9456-3152b0ffb396" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-fa054469-8cbe-4462-9456-3152b0ffb396" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c7bfe-73c6-4b38-be61-655fb57e639c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:21 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 Sep 11 14:01:21 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:21 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396" returned: 0 in 0.378s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:21 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396 Sep 11 14:01:21 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-dd4d8b87-e121-4473-8191-c0023003dfc8 req-8e0b0692-0fde-4cd2-83a6-737b899d1a95 tempest-TestMinimumBasicScenario-993719291 None] Terminate volume connection completed successfully. Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-dd4d8b87-e121-4473-8191-c0023003dfc8 req-8e0b0692-0fde-4cd2-83a6-737b899d1a95 tempest-TestMinimumBasicScenario-993719291 None] Deleting attachment 8a27604f-4109-471a-941d-97d0b450fefb. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:01:21 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fa054469-8cbe-4462-9456-3152b0ffb396" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-fa054469-8cbe-4462-9456-3152b0ffb396" released by "delete_volume" :: held 0.712s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Created reservations ['517a4c05-ea75-4b8b-9b34-6ef805e0f2e7', 'fd82898a-e17f-41cf-8689-ceb05c84e7a5', '14c6ebef-a2cb-45d1-bd08-18461ed54650', '5a6b70c2-085b-4f3b-b6b5-08af88de650d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:21 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:21 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:22 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-80e3208e-85d7-4f02-b687-7ff5518d8114 tempest-VolumesGetTest-372848608 None] Lock "cinder-fa054469-8cbe-4462-9456-3152b0ffb396-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-117fd314-acd0-41b5-a48d-6e01043d7f37-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Lock "cinder-117fd314-acd0-41b5-a48d-6e01043d7f37-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=119,cinder:UPDATE=137,cinder:DELETE=11,cinder:INSERT=30 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=135,cinder:INSERT=46,cinder:SELECT=95,cinder:DELETE=13 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Acquiring lock "cinder-quobyte-117fd314-acd0-41b5-a48d-6e01043d7f37" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-117fd314-acd0-41b5-a48d-6e01043d7f37" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64aaa2a-f985-4606-a943-8e22e2d303e3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:22 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 Sep 11 14:01:22 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Acquiring lock "cinder-ee76abfc-d124-45a1-b6d2-ed6299820193-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Lock "cinder-ee76abfc-d124-45a1-b6d2-ed6299820193-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Acquiring lock "cinder-quobyte-ee76abfc-d124-45a1-b6d2-ed6299820193" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Lock "cinder-quobyte-ee76abfc-d124-45a1-b6d2-ed6299820193" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f739d-0634-4fd5-8c09-705c4c656db9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:22 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37" returned: 0 in 0.421s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:22 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 Sep 11 14:01:22 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:22 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37 Sep 11 14:01:22 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:23 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-117fd314-acd0-41b5-a48d-6e01043d7f37" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Lock "cinder-quobyte-117fd314-acd0-41b5-a48d-6e01043d7f37" released by "delete_volume" :: held 0.745s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:23 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193" returned: 0 in 0.391s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:23 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193 Sep 11 14:01:23 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Created reservations ['e5efa26c-33a5-4395-82d4-65aeed21de21', '87814351-a175-40f3-9036-638568a7c04a', '76345b07-f9b0-4a1b-8c6b-561c0875c994', '8bc289c4-a433-41cf-95a7-1fabff5d2b3b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:23 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:23 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:23 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ee76abfc-d124-45a1-b6d2-ed6299820193" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Lock "cinder-quobyte-ee76abfc-d124-45a1-b6d2-ed6299820193" released by "delete_volume" :: held 0.679s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Created reservations ['26781ba8-8e4e-45bc-9b4c-b15593eb9326', 'ba8aa72f-315b-4db4-bfe5-3bd85dc1854d', '26a05081-6241-4f26-aeac-09d6be276267', '197e9a8d-aad0-4f6c-84f5-9234fd012907'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:01:23 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Deleted volume successfully. Sep 11 14:01:23 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:01:23 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ffb5e60e-b0a7-4116-b1d0-9d0e710c82ce tempest-VolumesGetTest-372848608 None] Lock "cinder-117fd314-acd0-41b5-a48d-6e01043d7f37-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:23 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.282s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:01:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Deleted volume successfully. Sep 11 14:01:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-bdadaff7-13c5-48e8-b5cb-4c6075be2c7d tempest-TestMinimumBasicScenario-993719291 None] Lock "cinder-ee76abfc-d124-45a1-b6d2-ed6299820193-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:01:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=5 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:01:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Flow 'volume_create_manager' (58c9a65b-bfb2-46ce-adf2-22cd1e58a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff1ce26-7060-447d-9bec-e04515dc916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff1ce26-7060-447d-9bec-e04515dc916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1839458244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedc69f3-471a-439a-877e-64b64893f2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df74f1ac7a8f42b4aa0a54633f9e906f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:54Z,use_quota=True,user_id='769c325242be4bc2b2d5ab7122cbfd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fb06801-4554-48e5-9876-ab33bf42d850),volume_type_id=1fb06801-4554-48e5-9876-ab33bf42d850)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43eb8e51-7f45-411e-8816-53a8f9d4c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43eb8e51-7f45-411e-8816-53a8f9d4c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d5367e-abcc-4bd4-bc87-84eefe9c22df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d5367e-abcc-4bd4-bc87-84eefe9c22df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dedc69f3-471a-439a-877e-64b64893f2cf', 'volume_name': 'volume-dedc69f3-471a-439a-877e-64b64893f2cf', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074585e5-88f7-4ee5-b002-c458e13a5218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074585e5-88f7-4ee5-b002-c458e13a5218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51dba19-fbd0-47c2-a529-b625efe7f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume dedc69f3-471a-439a-877e-64b64893f2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dedc69f3-471a-439a-877e-64b64893f2cf', 'volume_size': 1} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1839458244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedc69f3-471a-439a-877e-64b64893f2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df74f1ac7a8f42b4aa0a54633f9e906f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:54Z,use_quota=True,user_id='769c325242be4bc2b2d5ab7122cbfd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fb06801-4554-48e5-9876-ab33bf42d850),volume_type_id=1fb06801-4554-48e5-9876-ab33bf42d850)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Creating volume dedc69f3-471a-439a-877e-64b64893f2cf {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:01:54 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:54 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf 1073741824 Sep 11 14:01:54 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Flow 'volume_create_manager' (3504e736-5fc0-4001-a0f0-f3a2bf9c98e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05a1bba-150e-43ac-b1d3-efd3aad7deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05a1bba-150e-43ac-b1d3-efd3aad7deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-125314278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a34a3e-cea4-4264-a123-c3da2881dedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df74f1ac7a8f42b4aa0a54633f9e906f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:55Z,use_quota=True,user_id='769c325242be4bc2b2d5ab7122cbfd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13697b21-dc65-42b3-8894-77b79e3f982a),volume_type_id=13697b21-dc65-42b3-8894-77b79e3f982a)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ba966c-bbe6-4fd1-9b20-52566db2854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ba966c-bbe6-4fd1-9b20-52566db2854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ebd8b7-adc7-4c16-abdf-29c687aafab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ebd8b7-adc7-4c16-abdf-29c687aafab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a34a3e-cea4-4264-a123-c3da2881dedb', 'volume_name': 'volume-f3a34a3e-cea4-4264-a123-c3da2881dedb', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff8db96-c99d-47b1-a36a-73bb09db7010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff8db96-c99d-47b1-a36a-73bb09db7010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c342464-f304-46e4-8d8e-d0391d612bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume f3a34a3e-cea4-4264-a123-c3da2881dedb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a34a3e-cea4-4264-a123-c3da2881dedb', 'volume_size': 1} Sep 11 14:01:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:55 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf 1073741824" returned: 0 in 0.703s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:55 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf Sep 11 14:01:55 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:55 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf" returned: 0 in 0.310s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-125314278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a34a3e-cea4-4264-a123-c3da2881dedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df74f1ac7a8f42b4aa0a54633f9e906f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:55Z,use_quota=True,user_id='769c325242be4bc2b2d5ab7122cbfd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13697b21-dc65-42b3-8894-77b79e3f982a),volume_type_id=13697b21-dc65-42b3-8894-77b79e3f982a)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Creating volume f3a34a3e-cea4-4264-a123-c3da2881dedb {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:01:55 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:55 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb 1073741824 Sep 11 14:01:55 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51dba19-fbd0-47c2-a529-b625efe7f694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dedc69f3-471a-439a-877e-64b64893f2cf', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2754a1e4-4182-4ecb-b39b-7e7a33222050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Flow 'volume_create_manager' (efa00043-6af3-45d2-862f-bcb7da1b0ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09053f8-4f90-416c-b7db-fd09c9d73c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume volume-dedc69f3-471a-439a-877e-64b64893f2cf (dedc69f3-471a-439a-877e-64b64893f2cf): created successfully Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2754a1e4-4182-4ecb-b39b-7e7a33222050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Flow 'volume_create_manager' (58c9a65b-bfb2-46ce-adf2-22cd1e58a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09053f8-4f90-416c-b7db-fd09c9d73c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-221774865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df74f1ac7a8f42b4aa0a54633f9e906f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:55Z,use_quota=True,user_id='769c325242be4bc2b2d5ab7122cbfd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(576919ff-bbf9-40e6-9af5-902cea6aab34),volume_type_id=576919ff-bbf9-40e6-9af5-902cea6aab34)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffcbda5-361f-4fdf-bf79-fa6f5b893ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffcbda5-361f-4fdf-bf79-fa6f5b893ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acab3ff5-e715-4d79-9679-de4cc84cf4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 14:01:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9e1ace72-0557-4081-96cf-092b9560bc66 tempest-TestInstancesWithCinderVolumes-1712262854 None] Created volume successfully. Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acab3ff5-e715-4d79-9679-de4cc84cf4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd29c4ae0-cabb-4f31-b2ff-550f1f97a1a4', 'volume_name': 'volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4', 'volume_size': 1, 'image_id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3fdd247-f91c-4627-b528-bb2b9d69d939', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1041172872', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df74f1ac7a8f42b4aa0a54633f9e906f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'created_at': datetime.datetime(2026, 9, 11, 12, 1, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3fdd247-f91c-4627-b528-bb2b9d69d939/file', 'properties': {}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703538cc-557f-471f-9a65-eff070b6a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703538cc-557f-471f-9a65-eff070b6a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2295d9-3b30-4be3-83be-765bd8d14dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4', 'volume_size': 1, 'image_id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3fdd247-f91c-4627-b528-bb2b9d69d939', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1041172872', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df74f1ac7a8f42b4aa0a54633f9e906f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'created_at': datetime.datetime(2026, 9, 11, 12, 1, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3fdd247-f91c-4627-b528-bb2b9d69d939/file', 'properties': {}}, 'image_service': } Sep 11 14:01:55 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Trying to clone d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 from image a3fdd247-f91c-4627-b528-bb2b9d69d939 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3fdd247-f91c-4627-b528-bb2b9d69d939', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 14:01:56 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb 1073741824" returned: 0 in 0.515s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:56 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb Sep 11 14:01:56 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:56 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c342464-f304-46e4-8d8e-d0391d612bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a34a3e-cea4-4264-a123-c3da2881dedb', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaa4c75-36f4-4341-9437-2c2ae1ae6b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:01:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume volume-f3a34a3e-cea4-4264-a123-c3da2881dedb (f3a34a3e-cea4-4264-a123-c3da2881dedb): created successfully Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdaa4c75-36f4-4341-9437-2c2ae1ae6b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:01:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Flow 'volume_create_manager' (3504e736-5fc0-4001-a0f0-f3a2bf9c98e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:01:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-57875615-7a92-4fbf-aefa-61ca13d4b63b tempest-TestInstancesWithCinderVolumes-1712262854 None] Created volume successfully. Sep 11 14:01:59 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD, size 20.69 MB, duration 3.55 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 14:01:59 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Image download 20.69 MB at 5.82 MB/s Sep 11 14:01:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[693f5e03-bb1e-4d44-ad7b-fc18202bc798]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:01:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:01:59 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD Sep 11 14:01:59 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:01:59 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 11 14:01:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:01:59 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Temporary image a3fdd247-f91c-4627-b528-bb2b9d69d939 is fetched for user 769c325242be4bc2b2d5ab7122cbfd20. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6865b028-312a-4d2f-863c-869e7eef5393]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:00 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD Sep 11 14:02:00 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:00 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-221774865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df74f1ac7a8f42b4aa0a54633f9e906f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:01:55Z,use_quota=True,user_id='769c325242be4bc2b2d5ab7122cbfd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(576919ff-bbf9-40e6-9af5-902cea6aab34),volume_type_id=576919ff-bbf9-40e6-9af5-902cea6aab34)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Creating volume d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:02:00 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:00 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 1073741824 Sep 11 14:02:00 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:00 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 1073741824" returned: 0 in 0.464s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:00 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 Sep 11 14:02:00 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:01 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Attempting download of a3fdd247-f91c-4627-b528-bb2b9d69d939 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3fdd247-f91c-4627-b528-bb2b9d69d939', 'metadata': {}}])) to volume d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec84620-6347-4a93-97c7-ffebd0cf5453]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:01 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i Sep 11 14:02:01 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:01 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i" returned: 0 in 0.337s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:01 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i Sep 11 14:02:01 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:01 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i" returned: 1 in 0.359s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3fdd247-f91c-4627-b528-bb2b9d69d939_ahggo17i' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8d847-93fb-4a87-9731-122daaf4cc6a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:02 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD Sep 11 14:02:02 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:02 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:02 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] a3fdd247-f91c-4627-b528-bb2b9d69d939 was qcow2, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 14:02:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:02 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 Sep 11 14:02:02 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:04 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" returned: 0 in 1.827s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3fdd247-f91c-4627-b528-bb2b9d69d939_l1__6_b6devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:02:04 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Converted 112.00 MB image at 61.25 MB/s Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:04 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 1G Sep 11 14:02:04 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Flow 'volume_create_manager' (810383f7-2ec2-4a10-9a44-ee395803da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6653cc77-0c0a-4630-9a31-3712093891d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6653cc77-0c0a-4630-9a31-3712093891d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-425588343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ee603f-84a9-4f15-8d39-5270fa5a60db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bd136b3fd4025939755915a618bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:02:04Z,use_quota=True,user_id='e9eff2c99ee04eea922709544dc14ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfabdbb7-6c05-4f04-956e-4a49897fe6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfabdbb7-6c05-4f04-956e-4a49897fe6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c563f0f-02cb-4eed-b34d-a740b57bba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 14:02:04 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 1G" returned: 0 in 0.326s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Downloaded image a3fdd247-f91c-4627-b528-bb2b9d69d939 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3fdd247-f91c-4627-b528-bb2b9d69d939', 'metadata': {}}])) to volume d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Temporary image a3fdd247-f91c-4627-b528-bb2b9d69d939 for user 769c325242be4bc2b2d5ab7122cbfd20 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Marking volume d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Copying metadata from image a3fdd247-f91c-4627-b528-bb2b9d69d939 to d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Creating volume glance metadata for volume d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 backed by image a3fdd247-f91c-4627-b528-bb2b9d69d939 with: {'image_id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'image_name': 'tempest-scenario-img--1041172872', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2295d9-3b30-4be3-83be-765bd8d14dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4', 'volume_size': 1, 'image_id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3fdd247-f91c-4627-b528-bb2b9d69d939', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1041172872', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df74f1ac7a8f42b4aa0a54633f9e906f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3fdd247-f91c-4627-b528-bb2b9d69d939', 'created_at': datetime.datetime(2026, 9, 11, 12, 1, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3fdd247-f91c-4627-b528-bb2b9d69d939/file', 'properties': {}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a1b2ae-3ac9-4a29-bb4a-62535c6e1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Volume volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 (d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4): created successfully Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a1b2ae-3ac9-4a29-bb4a-62535c6e1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Flow 'volume_create_manager' (efa00043-6af3-45d2-862f-bcb7da1b0ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:02:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-235325e1-d502-49af-a08d-5e0436476a5a tempest-TestInstancesWithCinderVolumes-1712262854 None] Created volume successfully. Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c563f0f-02cb-4eed-b34d-a740b57bba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89ee603f-84a9-4f15-8d39-5270fa5a60db', 'volume_name': 'volume-89ee603f-84a9-4f15-8d39-5270fa5a60db', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3b1aee-cb53-488b-b5ff-d93db0f522ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3b1aee-cb53-488b-b5ff-d93db0f522ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e89f1cd-195f-4b5c-ad2f-12268b10387c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Volume 89ee603f-84a9-4f15-8d39-5270fa5a60db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89ee603f-84a9-4f15-8d39-5270fa5a60db', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 14:02:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Trying to clone 89ee603f-84a9-4f15-8d39-5270fa5a60db from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 14:02:05 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Image download 20.69 MB at 20.69 MB/s Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d225b908-2c4f-4ee2-b793-48b6d139408a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:05 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD Sep 11 14:02:05 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:05 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c is fetched for user e9eff2c99ee04eea922709544dc14ac2. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755017e-c15a-4353-b53b-dab436badf7f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:05 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD Sep 11 14:02:05 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:05 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-425588343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ee603f-84a9-4f15-8d39-5270fa5a60db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bd136b3fd4025939755915a618bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:02:04Z,use_quota=True,user_id='e9eff2c99ee04eea922709544dc14ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Creating volume 89ee603f-84a9-4f15-8d39-5270fa5a60db {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:02:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:02:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:05 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db 1073741824 Sep 11 14:02:05 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:06 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db 1073741824" returned: 0 in 0.478s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:06 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db Sep 11 14:02:06 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:06 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Attempting download of 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 89ee603f-84a9-4f15-8d39-5270fa5a60db. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59ceb3f-2faf-4bbb-b320-bc9e2b6918ed]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:06 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a Sep 11 14:02:06 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:07 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a" returned: 0 in 0.358s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:07 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a Sep 11 14:02:07 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:07 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a" returned: 1 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_ukeeqt2a' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100ce25-f3bc-4332-9779-8ceaa7868861]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:07 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD Sep 11 14:02:07 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-bcf12c5b-79c9-47ca-84a2-9c401f028bd2 req-6c25027a-9b6e-4f7d-96c8-195e99f48661 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-bcf12c5b-79c9-47ca-84a2-9c401f028bd2 req-6c25027a-9b6e-4f7d-96c8-195e99f48661 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-bcf12c5b-79c9-47ca-84a2-9c401f028bd2 req-6c25027a-9b6e-4f7d-96c8-195e99f48661 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-bcf12c5b-79c9-47ca-84a2-9c401f028bd2 req-6c25027a-9b6e-4f7d-96c8-195e99f48661 tempest-TestInstancesWithCinderVolumes-1712262854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6c1c558-1d7e-401a-a0e5-9b44250f6e00', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:02:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-bcf12c5b-79c9-47ca-84a2-9c401f028bd2 req-6c25027a-9b6e-4f7d-96c8-195e99f48661 tempest-TestInstancesWithCinderVolumes-1712262854 None] attachment_update completed successfully. Sep 11 14:02:07 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] 6b854647-c6a5-4221-a6fc-d6c3dbc5707c was qcow2, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 14:02:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:07 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db Sep 11 14:02:07 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:09 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db" returned: 0 in 1.871s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:09 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b854647-c6a5-4221-a6fc-d6c3dbc5707c_1l31nj76devstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:02:09 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Converted 112.00 MB image at 59.80 MB/s Sep 11 14:02:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:09 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db 1G Sep 11 14:02:09 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:10 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db 1G" returned: 0 in 0.395s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Downloaded image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c ((None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}])) to volume 89ee603f-84a9-4f15-8d39-5270fa5a60db successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Temporary image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c for user e9eff2c99ee04eea922709544dc14ac2 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Marking volume 89ee603f-84a9-4f15-8d39-5270fa5a60db as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Copying metadata from image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c to 89ee603f-84a9-4f15-8d39-5270fa5a60db. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Creating volume glance metadata for volume 89ee603f-84a9-4f15-8d39-5270fa5a60db backed by image 6b854647-c6a5-4221-a6fc-d6c3dbc5707c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e89f1cd-195f-4b5c-ad2f-12268b10387c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ee603f-84a9-4f15-8d39-5270fa5a60db', 'volume_size': 1, 'image_id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe55727ab8b4d72bc04a86f55da4adc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b854647-c6a5-4221-a6fc-d6c3dbc5707c', 'created_at': datetime.datetime(2026, 9, 11, 11, 41, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 11, 41, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b854647-c6a5-4221-a6fc-d6c3dbc5707c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42248ca5-c42a-4d58-85ef-0019c8d98183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:02:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Volume volume-89ee603f-84a9-4f15-8d39-5270fa5a60db (89ee603f-84a9-4f15-8d39-5270fa5a60db): created successfully Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42248ca5-c42a-4d58-85ef-0019c8d98183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Flow 'volume_create_manager' (810383f7-2ec2-4a10-9a44-ee395803da52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:02:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e140f503-8b54-42a9-b916-af46ece08888 tempest-TestShelveInstance-1351963663 None] Created volume successfully. Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:10 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:02:10 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:10 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.321s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:02:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:02:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f99aad41-4061-42b4-8bb4-78e2bdefb6c2 req-dcc21243-f04c-4cce-8db3-854b2685de0b tempest-TestShelveInstance-1351963663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f99aad41-4061-42b4-8bb4-78e2bdefb6c2 req-dcc21243-f04c-4cce-8db3-854b2685de0b tempest-TestShelveInstance-1351963663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f99aad41-4061-42b4-8bb4-78e2bdefb6c2 req-dcc21243-f04c-4cce-8db3-854b2685de0b tempest-TestShelveInstance-1351963663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f99aad41-4061-42b4-8bb4-78e2bdefb6c2 req-dcc21243-f04c-4cce-8db3-854b2685de0b tempest-TestShelveInstance-1351963663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-89ee603f-84a9-4f15-8d39-5270fa5a60db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b841c770-51b5-4c35-b777-4f9fa543735c', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:02:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f99aad41-4061-42b4-8bb4-78e2bdefb6c2 req-dcc21243-f04c-4cce-8db3-854b2685de0b tempest-TestShelveInstance-1351963663 None] attachment_update completed successfully. Sep 11 14:02:24 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=36,cinder:UPDATE=18,cinder:INSERT=16 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:02:24 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=18,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=4 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:02:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-a580cc02-1acc-4c84-bb2e-84b613d6ab0e req-de32e447-0ed8-40c8-a0e2-31e02c94d648 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-a580cc02-1acc-4c84-bb2e-84b613d6ab0e req-de32e447-0ed8-40c8-a0e2-31e02c94d648 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-a580cc02-1acc-4c84-bb2e-84b613d6ab0e req-de32e447-0ed8-40c8-a0e2-31e02c94d648 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-a580cc02-1acc-4c84-bb2e-84b613d6ab0e req-de32e447-0ed8-40c8-a0e2-31e02c94d648 tempest-TestInstancesWithCinderVolumes-1712262854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-dedc69f3-471a-439a-877e-64b64893f2cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71b2247d-e697-4c24-b0ad-fc60889aa7c9', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:02:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-a580cc02-1acc-4c84-bb2e-84b613d6ab0e req-de32e447-0ed8-40c8-a0e2-31e02c94d648 tempest-TestInstancesWithCinderVolumes-1712262854 None] attachment_update completed successfully. Sep 11 14:02:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f0d5f005-22f6-4627-9e21-fd6b5bc3d7f9 req-6e5c265b-6d31-4ba4-9a46-b80211ed8fb8 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f0d5f005-22f6-4627-9e21-fd6b5bc3d7f9 req-6e5c265b-6d31-4ba4-9a46-b80211ed8fb8 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f0d5f005-22f6-4627-9e21-fd6b5bc3d7f9 req-6e5c265b-6d31-4ba4-9a46-b80211ed8fb8 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:44 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f0d5f005-22f6-4627-9e21-fd6b5bc3d7f9 req-6e5c265b-6d31-4ba4-9a46-b80211ed8fb8 tempest-TestInstancesWithCinderVolumes-1712262854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-f3a34a3e-cea4-4264-a123-c3da2881dedb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4f20ecb-cd55-495a-8dba-51c27c9eb283', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:02:44 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f0d5f005-22f6-4627-9e21-fd6b5bc3d7f9 req-6e5c265b-6d31-4ba4-9a46-b80211ed8fb8 tempest-TestInstancesWithCinderVolumes-1712262854 None] attachment_update completed successfully. Sep 11 14:02:47 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-84358f96-ab1e-44a2-b837-db4f6efe9f7d req-027052ab-3129-4471-99b2-289afef302f4 tempest-TestShelveInstance-1351963663 None] Terminate volume connection completed successfully. Sep 11 14:02:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-84358f96-ab1e-44a2-b837-db4f6efe9f7d req-027052ab-3129-4471-99b2-289afef302f4 tempest-TestShelveInstance-1351963663 None] Deleting attachment b841c770-51b5-4c35-b777-4f9fa543735c. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:02:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f4b8f7d4-060b-44ac-8d14-dded896b7618 req-019e0dbd-7cbd-4ea3-acc3-38c454f9dd02 tempest-TestShelveInstance-1351963663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f4b8f7d4-060b-44ac-8d14-dded896b7618 req-019e0dbd-7cbd-4ea3-acc3-38c454f9dd02 tempest-TestShelveInstance-1351963663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f4b8f7d4-060b-44ac-8d14-dded896b7618 req-019e0dbd-7cbd-4ea3-acc3-38c454f9dd02 tempest-TestShelveInstance-1351963663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-6618e70d-1b20-4a83-acd6-60474647410f req-be843b10-9815-490e-b296-0e99b61d011f tempest-TestInstancesWithCinderVolumes-1712262854 None] Terminate volume connection completed successfully. Sep 11 14:02:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-6618e70d-1b20-4a83-acd6-60474647410f req-be843b10-9815-490e-b296-0e99b61d011f tempest-TestInstancesWithCinderVolumes-1712262854 None] Deleting attachment 71b2247d-e697-4c24-b0ad-fc60889aa7c9. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:02:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f4b8f7d4-060b-44ac-8d14-dded896b7618 req-019e0dbd-7cbd-4ea3-acc3-38c454f9dd02 tempest-TestShelveInstance-1351963663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-89ee603f-84a9-4f15-8d39-5270fa5a60db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62ce2bf3-2dd8-4f75-a664-35779f0fd0f8', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:02:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f4b8f7d4-060b-44ac-8d14-dded896b7618 req-019e0dbd-7cbd-4ea3-acc3-38c454f9dd02 tempest-TestShelveInstance-1351963663 None] attachment_update completed successfully. Sep 11 14:02:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "cinder-dedc69f3-471a-439a-877e-64b64893f2cf-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:02:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-dedc69f3-471a-439a-877e-64b64893f2cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:02:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "cinder-quobyte-dedc69f3-471a-439a-877e-64b64893f2cf" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:02:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-quobyte-dedc69f3-471a-439a-877e-64b64893f2cf" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:02:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb44828-2dfc-4677-875b-e20e00a67ac1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:49 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf Sep 11 14:02:49 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:50 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf" returned: 0 in 0.431s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:50 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf Sep 11 14:02:50 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:50 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-dedc69f3-471a-439a-877e-64b64893f2cf" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-quobyte-dedc69f3-471a-439a-877e-64b64893f2cf" released by "delete_volume" :: held 0.771s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:02:50 devstack cinder-volume[88731]: WARNING cinder.quota [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039988654-285807406 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039988654-285807406, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:02:50 devstack cinder-volume[88731]: WARNING cinder.quota [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039988654-285807406 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039988654-285807406, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Created reservations ['39954548-269a-4d8c-a76f-5413e615194e', '65345c7d-a908-4f56-8c1b-6f85363bad73', '94ae78e5-8304-4467-8e2c-d0f9c2d88dea', '80965090-90a2-48e6-b095-74f09c2a7bb5'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:50 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:02:50 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:51 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:51 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:02:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deleted volume successfully. Sep 11 14:02:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29bd7687-233d-4d41-8829-e1fb26661406 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-dedc69f3-471a-439a-877e-64b64893f2cf-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:02:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-8c3dcf60-93d4-4cdc-b8ad-fae182c4de1e req-409c9913-d5f3-417f-a6e1-863910855495 tempest-TestInstancesWithCinderVolumes-1712262854 None] Terminate volume connection completed successfully. Sep 11 14:02:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-8c3dcf60-93d4-4cdc-b8ad-fae182c4de1e req-409c9913-d5f3-417f-a6e1-863910855495 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deleting attachment c4f20ecb-cd55-495a-8dba-51c27c9eb283. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:02:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "cinder-f3a34a3e-cea4-4264-a123-c3da2881dedb-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:02:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-f3a34a3e-cea4-4264-a123-c3da2881dedb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:02:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "cinder-quobyte-f3a34a3e-cea4-4264-a123-c3da2881dedb" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:02:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-quobyte-f3a34a3e-cea4-4264-a123-c3da2881dedb" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:02:54 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[98150b11-9594-457e-b382-cf8980384ac8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:02:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:54 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb Sep 11 14:02:54 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:55 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb" returned: 0 in 0.461s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:55 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb Sep 11 14:02:55 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:55 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f3a34a3e-cea4-4264-a123-c3da2881dedb" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-quobyte-f3a34a3e-cea4-4264-a123-c3da2881dedb" released by "delete_volume" :: held 0.806s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:02:55 devstack cinder-volume[88731]: WARNING cinder.quota [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1429511821-1625159179 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1429511821-1625159179, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:02:55 devstack cinder-volume[88731]: WARNING cinder.quota [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1429511821-1625159179 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1429511821-1625159179, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Created reservations ['d4d377be-52a5-4365-a32d-1ea10dd9fa8a', '03c00b61-bf4c-48c3-9fcc-b5e8a65ea89c', '2582105e-b5ce-49e6-8b05-07477fd209a7', '8e9f4eed-ef0b-4e2c-9905-346bddf7b6f9'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:02:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:02:55 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:02:55 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:02:55 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 11 14:02:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.323s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:02:56 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:02:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deleted volume successfully. Sep 11 14:02:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f364da29-c45c-4f6b-a1a8-2e55d4414058 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-f3a34a3e-cea4-4264-a123-c3da2881dedb-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:02:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-dd0844a7-321a-435a-85be-1f309c69c242 req-66c13873-f97e-427c-b62a-3dc00a346f06 tempest-TestInstancesWithCinderVolumes-1712262854 None] Terminate volume connection completed successfully. Sep 11 14:02:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-dd0844a7-321a-435a-85be-1f309c69c242 req-66c13873-f97e-427c-b62a-3dc00a346f06 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deleting attachment e6c1c558-1d7e-401a-a0e5-9b44250f6e00. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:02:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "cinder-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:02:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:02:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "cinder-quobyte-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-quobyte-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba2642-b77b-4a0a-844a-1eb41654911b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:00 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 Sep 11 14:03:00 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:00 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:00 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4 Sep 11 14:03:00 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:00 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-quobyte-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4" released by "delete_volume" :: held 0.673s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:03:00 devstack cinder-volume[88731]: WARNING cinder.quota [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867156250-180861074 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867156250-180861074, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:03:00 devstack cinder-volume[88731]: WARNING cinder.quota [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867156250-180861074 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867156250-180861074, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Created reservations ['e329fc22-1f70-4f18-9b01-67cb2ddfe864', 'c45ef505-0db4-44a1-90b0-dec69e30a319', '41efcf5f-741c-4b9c-bc61-64382fbfe1a8', 'f0589f28-6612-44f1-be6d-4319cb4b303e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:03:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:00 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:03:00 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:01 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:01 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:03:01 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Deleted volume successfully. Sep 11 14:03:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cda5e531-de13-4c3b-8f0b-8e024b2f3d57 tempest-TestInstancesWithCinderVolumes-1712262854 None] Lock "cinder-d29c4ae0-cabb-4f31-b2ff-550f1f97a1a4-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:10 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:03:10 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=41,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:03:10 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:03:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:03:11 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=36,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:03:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:03:33 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:03:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-54fed194-1070-4797-a118-7401d382c80d req-ed25e4e9-b453-48b8-8694-152772f423b1 tempest-TestShelveInstance-1351963663 None] Terminate volume connection completed successfully. Sep 11 14:03:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-54fed194-1070-4797-a118-7401d382c80d req-ed25e4e9-b453-48b8-8694-152772f423b1 tempest-TestShelveInstance-1351963663 None] Deleting attachment 62ce2bf3-2dd8-4f75-a664-35779f0fd0f8. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:03:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Acquiring lock "cinder-89ee603f-84a9-4f15-8d39-5270fa5a60db-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:03:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Lock "cinder-89ee603f-84a9-4f15-8d39-5270fa5a60db-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:03:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Acquiring lock "cinder-quobyte-89ee603f-84a9-4f15-8d39-5270fa5a60db" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:03:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Lock "cinder-quobyte-89ee603f-84a9-4f15-8d39-5270fa5a60db" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:03:34 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6262f1-9863-4561-8697-bdad9efe39ea]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:03:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:34 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db Sep 11 14:03:34 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:34 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db" returned: 0 in 0.648s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:34 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db Sep 11 14:03:34 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:35 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-89ee603f-84a9-4f15-8d39-5270fa5a60db" returned: 0 in 0.294s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Lock "cinder-quobyte-89ee603f-84a9-4f15-8d39-5270fa5a60db" released by "delete_volume" :: held 1.012s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG cinder.quota [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Created reservations ['c931dc42-6278-46c5-a713-5efe406b3431', '214fa25d-ce84-4575-b07d-182148dc8a97', '6fad70ff-169e-4a50-86aa-8621702e8452', '684de755-1489-49be-9ff3-f935edd84e01'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:03:35 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:03:35 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:03:35 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG cinder.manager [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:03:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Deleted volume successfully. Sep 11 14:03:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [req-54fed194-1070-4797-a118-7401d382c80d req-fe8d831f-4612-4d6e-98bb-d8a86e1b6b43 tempest-TestShelveInstance-1351963663 None] Lock "cinder-89ee603f-84a9-4f15-8d39-5270fa5a60db-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:03:45 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:03:45 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Flow 'volume_create_manager' (1fa1a318-9d83-4488-823d-6ba69b2e0dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138b91e8-e5e7-4cb1-95e1-6342758a1bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138b91e8-e5e7-4cb1-95e1-6342758a1bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1716966649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6fbc2e-fd94-468d-9ec3-49b3b6c79823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67139105e0a540308b1d231b6dcdf5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:03Z,use_quota=True,user_id='2b1deb9d8bb449bc82886301f3d06e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be6fc8-ac21-43d9-8ac9-346e17653bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be6fc8-ac21-43d9-8ac9-346e17653bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff72e78e-649b-416c-a9ff-890b88d7e65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff72e78e-649b-416c-a9ff-890b88d7e65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6fbc2e-fd94-468d-9ec3-49b3b6c79823', 'volume_name': 'volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31576ad0-cc0c-4bc9-8236-3f46211d4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31576ad0-cc0c-4bc9-8236-3f46211d4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44d0d09-8f5e-4311-92dd-d8b956691e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Volume 0a6fbc2e-fd94-468d-9ec3-49b3b6c79823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823', 'volume_size': 1} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1716966649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6fbc2e-fd94-468d-9ec3-49b3b6c79823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67139105e0a540308b1d231b6dcdf5f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:03Z,use_quota=True,user_id='2b1deb9d8bb449bc82886301f3d06e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Creating volume 0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:04:03 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:03 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 1073741824 Sep 11 14:04:03 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:03 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 1073741824" returned: 0 in 0.468s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:03 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 Sep 11 14:04:03 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:04 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44d0d09-8f5e-4311-92dd-d8b956691e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228bb2b0-96ce-48f2-889d-09a6ee1dd623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:04 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Volume volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 (0a6fbc2e-fd94-468d-9ec3-49b3b6c79823): created successfully Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228bb2b0-96ce-48f2-889d-09a6ee1dd623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Flow 'volume_create_manager' (1fa1a318-9d83-4488-823d-6ba69b2e0dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-070040da-de85-49e5-90d5-196ff74666d8 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Created volume successfully. Sep 11 14:04:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f3de90ab-9da9-4a49-a8cb-71eca4047580 req-0cdab028-a758-4a06-82da-bd1b9ffa2d4c tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f3de90ab-9da9-4a49-a8cb-71eca4047580 req-0cdab028-a758-4a06-82da-bd1b9ffa2d4c tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-f3de90ab-9da9-4a49-a8cb-71eca4047580 req-0cdab028-a758-4a06-82da-bd1b9ffa2d4c tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-f3de90ab-9da9-4a49-a8cb-71eca4047580 req-0cdab028-a758-4a06-82da-bd1b9ffa2d4c tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50a4cc9d-b76e-4292-97d5-a0b1db9da273', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:04:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-f3de90ab-9da9-4a49-a8cb-71eca4047580 req-0cdab028-a758-4a06-82da-bd1b9ffa2d4c tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] attachment_update completed successfully. Sep 11 14:04:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-fe95958a-5428-43e4-934c-adf119f0f174 req-016f247c-15ab-45df-9905-5d1567c42919 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Terminate volume connection completed successfully. Sep 11 14:04:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-fe95958a-5428-43e4-934c-adf119f0f174 req-016f247c-15ab-45df-9905-5d1567c42919 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Deleting attachment 50a4cc9d-b76e-4292-97d5-a0b1db9da273. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:04:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Acquiring lock "cinder-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:04:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "cinder-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:04:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Acquiring lock "cinder-quobyte-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:04:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "cinder-quobyte-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:04:09 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa7e275-184a-4fef-bf57-d68e754c334e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:04:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:09 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 Sep 11 14:04:09 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:10 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823" returned: 0 in 0.398s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:10 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823 Sep 11 14:04:10 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:10 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823" returned: 0 in 0.267s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "cinder-quobyte-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823" released by "delete_volume" :: held 0.714s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Created reservations ['db0d1808-68cd-4f35-bbd4-c7dbd08e5ea5', 'e8c2b07f-56a1-4ba7-bc40-905bcdf9924e', 'a891ba58-166e-4bbb-897c-f665e6637015', '1a7b1f2b-ddb3-4c84-aeec-a4742ce825d4'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:10 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:04:10 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:10 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:04:10 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:10 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:04:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Deleted volume successfully. Sep 11 14:04:10 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.300s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ca5ba284-9ccb-466b-8039-11e7d87be1b5 tempest-TestServerVolumeAttachScenarioOldVersion-2060489054 None] Lock "cinder-0a6fbc2e-fd94-468d-9ec3-49b3b6c79823-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:04:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Flow 'volume_create_manager' (89160d54-3583-42fb-9b70-794eb9b6f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cab0e4b-1fbf-4ebb-a85a-42f621b828fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cab0e4b-1fbf-4ebb-a85a-42f621b828fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-689509628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a635b746-e81a-421a-a8b2-558e23035cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542e754c7194522a4a30ffcf13a39b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:13Z,use_quota=True,user_id='c576ecc17bbf4bb8a26f96a17833cf34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6154d89-cbed-4f7d-abce-4d793d847828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6154d89-cbed-4f7d-abce-4d793d847828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e492bfb-186b-4e72-8207-ea0bdd8bcbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e492bfb-186b-4e72-8207-ea0bdd8bcbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a635b746-e81a-421a-a8b2-558e23035cda', 'volume_name': 'volume-a635b746-e81a-421a-a8b2-558e23035cda', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f51589-f318-440b-9723-f7367d2676fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f51589-f318-440b-9723-f7367d2676fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10991b87-0634-4f4e-9409-cc788c56d552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:12 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Volume a635b746-e81a-421a-a8b2-558e23035cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a635b746-e81a-421a-a8b2-558e23035cda', 'volume_size': 1} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-689509628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a635b746-e81a-421a-a8b2-558e23035cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542e754c7194522a4a30ffcf13a39b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:13Z,use_quota=True,user_id='c576ecc17bbf4bb8a26f96a17833cf34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Creating volume a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:04:12 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:04:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:12 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda 1073741824 Sep 11 14:04:12 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:13 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda 1073741824" returned: 0 in 0.489s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:13 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda Sep 11 14:04:13 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:13 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10991b87-0634-4f4e-9409-cc788c56d552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a635b746-e81a-421a-a8b2-558e23035cda', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fed712-5455-49d5-afdb-965ab1886040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:13 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Volume volume-a635b746-e81a-421a-a8b2-558e23035cda (a635b746-e81a-421a-a8b2-558e23035cda): created successfully Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fed712-5455-49d5-afdb-965ab1886040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Flow 'volume_create_manager' (89160d54-3583-42fb-9b70-794eb9b6f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0e04f5ca-854e-46fa-9f17-30c0e8ce0bbf tempest-TestStampPattern-1770690345 None] Created volume successfully. Sep 11 14:04:23 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:04:23 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=17,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:04:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-1bbe67dc-d8ee-4a87-9238-65f7a63ccbe3 req-93d0e4ec-489a-48cf-a813-518791d2adbb tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-1bbe67dc-d8ee-4a87-9238-65f7a63ccbe3 req-93d0e4ec-489a-48cf-a813-518791d2adbb tempest-TestStampPattern-1770690345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-1bbe67dc-d8ee-4a87-9238-65f7a63ccbe3 req-93d0e4ec-489a-48cf-a813-518791d2adbb tempest-TestStampPattern-1770690345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-1bbe67dc-d8ee-4a87-9238-65f7a63ccbe3 req-93d0e4ec-489a-48cf-a813-518791d2adbb tempest-TestStampPattern-1770690345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-a635b746-e81a-421a-a8b2-558e23035cda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8bd3a46-0b6d-4f87-81ef-7104c6833571', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:04:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-1bbe67dc-d8ee-4a87-9238-65f7a63ccbe3 req-93d0e4ec-489a-48cf-a813-518791d2adbb tempest-TestStampPattern-1770690345 None] attachment_update completed successfully. Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Flow 'volume_create_manager' (f19f9fe1-08ef-404e-a40a-ed1e7b48f2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4592329a-44bc-4558-aac3-5b45a46eb5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4592329a-44bc-4558-aac3-5b45a46eb5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1773481887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c796f797-9c23-4cad-9ca1-c5c0220a2a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4451d2d03a21499ebb592c73d87467dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:47Z,use_quota=True,user_id='828f61796f464f1997d692fcdcecc4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7415d301-2caa-48bf-8820-ea96fc669b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7415d301-2caa-48bf-8820-ea96fc669b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0cc140-98c0-48c0-ad06-1dc682a20e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0cc140-98c0-48c0-ad06-1dc682a20e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c796f797-9c23-4cad-9ca1-c5c0220a2a7d', 'volume_name': 'volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e47e58f-3f77-44b7-a7b6-a6d76b050edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e47e58f-3f77-44b7-a7b6-a6d76b050edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead54ce2-2544-4da1-bc5d-4eb90be41913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:46 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Volume c796f797-9c23-4cad-9ca1-c5c0220a2a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d', 'volume_size': 1} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1773481887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c796f797-9c23-4cad-9ca1-c5c0220a2a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4451d2d03a21499ebb592c73d87467dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:47Z,use_quota=True,user_id='828f61796f464f1997d692fcdcecc4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Creating volume c796f797-9c23-4cad-9ca1-c5c0220a2a7d {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:04:46 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:04:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:47 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d 1073741824 Sep 11 14:04:47 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Flow 'volume_create_manager' (3627caac-c909-4de6-9c0b-b26fe7c150fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9e925-165e-49d7-8d0c-796f62377dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9e925-165e-49d7-8d0c-796f62377dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1524506987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62eab059-5a90-4ff5-8edd-7cb90f04cc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4451d2d03a21499ebb592c73d87467dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:47Z,use_quota=True,user_id='828f61796f464f1997d692fcdcecc4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa026c4-54fd-4167-9687-84c4388556c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa026c4-54fd-4167-9687-84c4388556c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006eadba-07c4-43ec-94ac-670c79e312c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006eadba-07c4-43ec-94ac-670c79e312c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62eab059-5a90-4ff5-8edd-7cb90f04cc31', 'volume_name': 'volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82c2ed3-c87b-4a9a-b5c0-8dfaddfae725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82c2ed3-c87b-4a9a-b5c0-8dfaddfae725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571dad31-ae8a-460b-8247-0841918753be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:47 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Volume 62eab059-5a90-4ff5-8edd-7cb90f04cc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31', 'volume_size': 1} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:47 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d 1073741824" returned: 0 in 0.664s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:47 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d Sep 11 14:04:47 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:47 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1524506987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62eab059-5a90-4ff5-8edd-7cb90f04cc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4451d2d03a21499ebb592c73d87467dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:04:47Z,use_quota=True,user_id='828f61796f464f1997d692fcdcecc4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Creating volume 62eab059-5a90-4ff5-8edd-7cb90f04cc31 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:04:47 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead54ce2-2544-4da1-bc5d-4eb90be41913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:47 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6edc3a0-67ca-4df7-ac5a-79b4a0d91c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:47 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 1073741824 Sep 11 14:04:48 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Volume volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d (c796f797-9c23-4cad-9ca1-c5c0220a2a7d): created successfully Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6edc3a0-67ca-4df7-ac5a-79b4a0d91c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Flow 'volume_create_manager' (f19f9fe1-08ef-404e-a40a-ed1e7b48f2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-20731c10-9d70-4cf0-86ac-dbe26bcf5362 tempest-TestServerVolumeAttachmentScenario-594445686 None] Created volume successfully. Sep 11 14:04:48 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 1073741824" returned: 0 in 0.522s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:48 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 Sep 11 14:04:48 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-8be46c98-f985-4858-87fe-81da7a14b5c6 req-84217b04-3c02-43db-9d51-2e88b82092c7 tempest-TestStampPattern-1770690345 None] Terminate volume connection completed successfully. Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-8be46c98-f985-4858-87fe-81da7a14b5c6 req-84217b04-3c02-43db-9d51-2e88b82092c7 tempest-TestStampPattern-1770690345 None] Deleting attachment f8bd3a46-0b6d-4f87-81ef-7104c6833571. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:04:48 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31" returned: 0 in 0.276s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571dad31-ae8a-460b-8247-0841918753be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a58efe-9a45-4da3-82f6-a114b34b0f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Volume volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 (62eab059-5a90-4ff5-8edd-7cb90f04cc31): created successfully Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a58efe-9a45-4da3-82f6-a114b34b0f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Flow 'volume_create_manager' (3627caac-c909-4de6-9c0b-b26fe7c150fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d2700020-5a2e-4ac7-9db6-76be07dc562b tempest-TestServerVolumeAttachmentScenario-594445686 None] Created volume successfully. Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Creating offline snapshot dd0012f4-b1a8-4c54-935b-572995791752 of volume a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b0763-58c3-4f57-8cf4-1b52fbe40fee]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:49 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda Sep 11 14:04:49 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:49 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:49 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 1G Sep 11 14:04:49 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:50 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 1G" returned: 0 in 0.430s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a635b746-e81a-421a-a8b2-558e23035cda -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:50 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a635b746-e81a-421a-a8b2-558e23035cda -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 Sep 11 14:04:50 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:50 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a635b746-e81a-421a-a8b2-558e23035cda -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:50 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 is being set with open permissions: ugo+rw Sep 11 14:04:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:50 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 Sep 11 14:04:50 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:50 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:51 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info Sep 11 14:04:51 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:51 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:51 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info is being set with open permissions: ugo+rw Sep 11 14:04:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:04:51 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info Sep 11 14:04:51 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:04:51 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 11 14:04:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.info" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:04:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-21c94cbb-3b2e-4d28-9a17-41f000ecc137 tempest-TestStampPattern-1770690345 None] Create snapshot completed successfully Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Flow 'volume_create_manager' (75b64231-614e-420c-befb-9006332cecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52168a0-7f48-4d07-80e4-ec5012f45c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52168a0-7f48-4d07-80e4-ec5012f45c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1252782273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25d08e-1bc7-448a-8c73-58863f3b96ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5542e754c7194522a4a30ffcf13a39b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd0012f4-b1a8-4c54-935b-572995791752,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:05:00Z,use_quota=True,user_id='c576ecc17bbf4bb8a26f96a17833cf34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1976fb00-4081-4481-904b-6a9a9dee0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1976fb00-4081-4481-904b-6a9a9dee0979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9381ccad-e17b-425b-b949-2d30dc75f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9381ccad-e17b-425b-b949-2d30dc75f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba25d08e-1bc7-448a-8c73-58863f3b96ab', 'volume_name': 'volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab', 'volume_size': 1, 'snapshot_id': 'dd0012f4-b1a8-4c54-935b-572995791752'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ee8cd9-b12d-4825-9067-043d49be615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ee8cd9-b12d-4825-9067-043d49be615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36e2838-9b27-4fdf-8620-e1b82bac33fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:04:59 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Volume ba25d08e-1bc7-448a-8c73-58863f3b96ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab', 'volume_size': 1, 'snapshot_id': 'dd0012f4-b1a8-4c54-935b-572995791752'} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-quobyte-dd0012f4-b1a8-4c54-935b-572995791752-ba25d08e-1bc7-448a-8c73-58863f3b96ab" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-dd0012f4-b1a8-4c54-935b-572995791752-ba25d08e-1bc7-448a-8c73-58863f3b96ab" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Creating volume ba25d08e-1bc7-448a-8c73-58863f3b96ab from snapshot dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-quobyte-ba25d08e-1bc7-448a-8c73-58863f3b96ab" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-ba25d08e-1bc7-448a-8c73-58863f3b96ab" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] snapshot: dd0012f4-b1a8-4c54-935b-572995791752, volume: ba25d08e-1bc7-448a-8c73-58863f3b96ab, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8cfa71-ec94-4962-98fe-fa55288b99d2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:04:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:00 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 Sep 11 14:05:00 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:00 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752" returned: 0 in 0.380s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a635b746-e81a-421a-a8b2-558e23035cda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0204e9-0a50-401f-a07a-a0ea362f9dbd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:00 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda Sep 11 14:05:00 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:00 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda" returned: 0 in 0.409s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 14:05:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:00 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab Sep 11 14:05:00 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:07 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab" returned: 0 in 7.282s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:07 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:05:07 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Converted 1024.00 MB image at 140.57 MB/s Sep 11 14:05:07 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab is being set with open permissions: ugo+rw Sep 11 14:05:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:08 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab Sep 11 14:05:08 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:08 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-ba25d08e-1bc7-448a-8c73-58863f3b96ab" released by "_copy_volume_from_snapshot" :: held 8.461s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-dd0012f4-b1a8-4c54-935b-572995791752-ba25d08e-1bc7-448a-8c73-58863f3b96ab" released by "_create_volume_from_snapshot" :: held 8.550s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.570s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36e2838-9b27-4fdf-8620-e1b82bac33fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab', 'volume_size': 1, 'snapshot_id': 'dd0012f4-b1a8-4c54-935b-572995791752'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11ebae0-a9bc-4570-a5a7-12a45ee9f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Volume volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab (ba25d08e-1bc7-448a-8c73-58863f3b96ab): created successfully Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11ebae0-a9bc-4570-a5a7-12a45ee9f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Flow 'volume_create_manager' (75b64231-614e-420c-befb-9006332cecca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:05:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-07769f09-48bc-459b-a0ad-88a7d77f986e tempest-TestStampPattern-1770690345 None] Created volume successfully. Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:10 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:05:10 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:10 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:05:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:05:18 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:05:18 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:DELETE=3 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:05:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-e22b2074-ec60-477d-9a3f-6468796d10e2 req-f6959029-6947-42b7-a3d4-29493d43a129 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-e22b2074-ec60-477d-9a3f-6468796d10e2 req-f6959029-6947-42b7-a3d4-29493d43a129 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-e22b2074-ec60-477d-9a3f-6468796d10e2 req-f6959029-6947-42b7-a3d4-29493d43a129 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-e22b2074-ec60-477d-9a3f-6468796d10e2 req-f6959029-6947-42b7-a3d4-29493d43a129 tempest-TestServerVolumeAttachmentScenario-594445686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd691e8e0-d92c-426b-bc20-b1481579a2ff', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:05:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-e22b2074-ec60-477d-9a3f-6468796d10e2 req-f6959029-6947-42b7-a3d4-29493d43a129 tempest-TestServerVolumeAttachmentScenario-594445686 None] attachment_update completed successfully. Sep 11 14:05:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-880aea8d-f100-4e33-9827-8335d81baa02 req-e774862c-38ed-45c4-9849-c4850f77d66e tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-880aea8d-f100-4e33-9827-8335d81baa02 req-e774862c-38ed-45c4-9849-c4850f77d66e tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-880aea8d-f100-4e33-9827-8335d81baa02 req-e774862c-38ed-45c4-9849-c4850f77d66e tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:23 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-880aea8d-f100-4e33-9827-8335d81baa02 req-e774862c-38ed-45c4-9849-c4850f77d66e tempest-TestServerVolumeAttachmentScenario-594445686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd73098c0-8557-4ba8-aa0c-0e6cac3ad02e', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:05:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-880aea8d-f100-4e33-9827-8335d81baa02 req-e774862c-38ed-45c4-9849-c4850f77d66e tempest-TestServerVolumeAttachmentScenario-594445686 None] attachment_update completed successfully. Sep 11 14:05:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-8431d857-51af-464e-be7c-5653b03b14d3 req-051ed152-223d-4ad5-bdb0-0182546daef0 tempest-TestServerVolumeAttachmentScenario-594445686 None] Terminate volume connection completed successfully. Sep 11 14:05:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-8431d857-51af-464e-be7c-5653b03b14d3 req-051ed152-223d-4ad5-bdb0-0182546daef0 tempest-TestServerVolumeAttachmentScenario-594445686 None] Deleting attachment d73098c0-8557-4ba8-aa0c-0e6cac3ad02e. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:05:26 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-917d0793-e9ee-4139-bb4f-1f5a97942499 req-0f3165d9-0d7f-4b05-b5f2-46b6b17a6346 tempest-TestServerVolumeAttachmentScenario-594445686 None] Terminate volume connection completed successfully. Sep 11 14:05:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-917d0793-e9ee-4139-bb4f-1f5a97942499 req-0f3165d9-0d7f-4b05-b5f2-46b6b17a6346 tempest-TestServerVolumeAttachmentScenario-594445686 None] Deleting attachment d691e8e0-d92c-426b-bc20-b1481579a2ff. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:05:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "cinder-62eab059-5a90-4ff5-8edd-7cb90f04cc31-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-62eab059-5a90-4ff5-8edd-7cb90f04cc31-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "cinder-quobyte-62eab059-5a90-4ff5-8edd-7cb90f04cc31" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-quobyte-62eab059-5a90-4ff5-8edd-7cb90f04cc31" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d8ec2-6e61-4c89-95a8-6975388ce80a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:31 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 Sep 11 14:05:31 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:31 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:31 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31 Sep 11 14:05:31 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:31 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-62eab059-5a90-4ff5-8edd-7cb90f04cc31" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-quobyte-62eab059-5a90-4ff5-8edd-7cb90f04cc31" released by "delete_volume" :: held 0.638s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Created reservations ['6ab565bf-4241-4b6a-b438-fbadf881142f', '2465de68-68a2-4dfa-bdeb-f61589668597', 'e0e9899a-c2bb-4ad4-9d39-312c60a211c3', 'e903a222-0c73-4199-acd2-ed11cc378301'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:31 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:05:31 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:32 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:05:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Deleted volume successfully. Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-37f552a0-68fd-49ea-8381-b2267c3bf089 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-62eab059-5a90-4ff5-8edd-7cb90f04cc31-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "cinder-c796f797-9c23-4cad-9ca1-c5c0220a2a7d-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-c796f797-9c23-4cad-9ca1-c5c0220a2a7d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "cinder-quobyte-c796f797-9c23-4cad-9ca1-c5c0220a2a7d" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-quobyte-c796f797-9c23-4cad-9ca1-c5c0220a2a7d" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0e9d07-47be-4d10-b054-fdbb43da68a1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:32 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d Sep 11 14:05:32 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:32 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:32 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d Sep 11 14:05:32 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:32 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c796f797-9c23-4cad-9ca1-c5c0220a2a7d" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-quobyte-c796f797-9c23-4cad-9ca1-c5c0220a2a7d" released by "delete_volume" :: held 0.631s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Created reservations ['019099c5-7e67-4797-a93b-c72e9d5d7ebf', 'b436b76b-da97-4e3d-94fa-8a7fe901b2af', '4576d2fc-72f5-4f5d-810e-45b22d017d95', '894f6aa6-3469-4be6-b3a3-3ac1db31e707'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:32 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:05:32 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:33 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.241s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:33 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:05:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Deleted volume successfully. Sep 11 14:05:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-af3b6a2c-64dd-4e94-b970-43b2ce4f4ab6 tempest-TestServerVolumeAttachmentScenario-594445686 None] Lock "cinder-c796f797-9c23-4cad-9ca1-c5c0220a2a7d-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-2197fd0c-6ab2-45c5-afbc-a5999c243f62 req-3dccf458-33b4-4ef5-b36d-945dd6382252 tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-2197fd0c-6ab2-45c5-afbc-a5999c243f62 req-3dccf458-33b4-4ef5-b36d-945dd6382252 tempest-TestStampPattern-1770690345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [req-2197fd0c-6ab2-45c5-afbc-a5999c243f62 req-3dccf458-33b4-4ef5-b36d-945dd6382252 tempest-TestStampPattern-1770690345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-2197fd0c-6ab2-45c5-afbc-a5999c243f62 req-3dccf458-33b4-4ef5-b36d-945dd6382252 tempest-TestStampPattern-1770690345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af', 'name': 'volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99a14ba2-6323-4461-b032-37f534ed545b', 'enforce_multipath': True} {{(pid=88731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 14:05:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-2197fd0c-6ab2-45c5-afbc-a5999c243f62 req-3dccf458-33b4-4ef5-b36d-945dd6382252 tempest-TestStampPattern-1770690345 None] attachment_update completed successfully. Sep 11 14:05:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [req-b70c904a-1a96-41cb-9469-c019b0f925f9 req-344d000e-e372-48dd-99bc-7fa2f602e022 tempest-TestStampPattern-1770690345 None] Terminate volume connection completed successfully. Sep 11 14:05:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [req-b70c904a-1a96-41cb-9469-c019b0f925f9 req-344d000e-e372-48dd-99bc-7fa2f602e022 tempest-TestStampPattern-1770690345 None] Deleting attachment 99a14ba2-6323-4461-b032-37f534ed545b. {{(pid=88731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 14:05:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-ba25d08e-1bc7-448a-8c73-58863f3b96ab-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Lock "cinder-ba25d08e-1bc7-448a-8c73-58863f3b96ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-quobyte-ba25d08e-1bc7-448a-8c73-58863f3b96ab" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-ba25d08e-1bc7-448a-8c73-58863f3b96ab" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:45 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc4a9db-74e0-4471-9573-93714ff22666]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:46 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab Sep 11 14:05:46 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:46 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab" returned: 0 in 0.410s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:46 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab Sep 11 14:05:46 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:46 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ba25d08e-1bc7-448a-8c73-58863f3b96ab" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-ba25d08e-1bc7-448a-8c73-58863f3b96ab" released by "delete_volume" :: held 0.705s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Created reservations ['c22a4672-61c5-40b5-bc30-468e7addd48d', '3b04d92c-cb41-456c-b2f3-fbdbf0c80d65', '71f66e8d-29a3-4a52-855b-10923c3a9e0b', '7a86cc42-3479-4ea1-b8f9-70d17d3735ab'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:46 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:05:46 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:46 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:05:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Deleted volume successfully. Sep 11 14:05:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9ec6ce64-da2b-426e-86e1-9df7ff7db12a tempest-TestStampPattern-1770690345 None] Lock "cinder-ba25d08e-1bc7-448a-8c73-58863f3b96ab-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-dd0012f4-b1a8-4c54-935b-572995791752-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Lock "cinder-dd0012f4-b1a8-4c54-935b-572995791752-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-quobyte-a635b746-e81a-421a-a8b2-558e23035cda" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-a635b746-e81a-421a-a8b2-558e23035cda" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-quobyte-dd0012f4-b1a8-4c54-935b-572995791752" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-dd0012f4-b1a8-4c54-935b-572995791752" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Deleting offline snapshot dd0012f4-b1a8-4c54-935b-572995791752 of volume a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] snapshot_file for this snap is: volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd73bf7-c71e-419e-b62a-4d5def1771a9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:47 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 Sep 11 14:05:47 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:47 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752" returned: 0 in 0.376s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a635b746-e81a-421a-a8b2-558e23035cda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4b867e-15e3-41dc-bebc-cc87210c0324]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:47 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda Sep 11 14:05:47 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:48 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda" returned: 0 in 0.527s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:48 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 Sep 11 14:05:48 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:48 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752" returned: 0 in 0.354s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:48 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752 Sep 11 14:05:48 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:48 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda.dd0012f4-b1a8-4c54-935b-572995791752" returned: 0 in 0.240s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-dd0012f4-b1a8-4c54-935b-572995791752" released by "_delete_snapshot" :: held 1.613s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-a635b746-e81a-421a-a8b2-558e23035cda" released by "delete_snapshot" :: held 1.638s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:48 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Created reservations ['6a9fdd97-be77-4307-8a4c-eaecfab9bb77', '88533f2c-5102-4995-8cd7-f8ffd0d3e254', '2ba5ff99-e23f-4510-b376-4e367974c715', '91edff6f-29cf-4234-b5be-e8f9d4882967'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:05:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Delete snapshot completed successfully. Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-675823d2-e6a7-4b09-863b-2f9e77acd13b tempest-TestStampPattern-1770690345 None] Lock "cinder-dd0012f4-b1a8-4c54-935b-572995791752-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Flow 'volume_create_manager' (5248c4de-57f9-496e-848a-149d766faba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc3d4a0-3461-4451-b6cb-8646e5ce3af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc3d4a0-3461-4451-b6cb-8646e5ce3af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e89f640-2928-4ac0-93f9-6583b32ed5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abf771377f4456099e969318f412198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:05:49Z,use_quota=True,user_id='cf9f3b00acef44c380b51594500d6c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec03ce0-3ee4-4536-9741-ddf671631a55),volume_type_id=fec03ce0-3ee4-4536-9741-ddf671631a55)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225aa644-5fe1-4b9a-8f58-86e870cdab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225aa644-5fe1-4b9a-8f58-86e870cdab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261a3545-9e2e-441d-8442-59bb263e33a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261a3545-9e2e-441d-8442-59bb263e33a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e89f640-2928-4ac0-93f9-6583b32ed5f3', 'volume_name': 'volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3', 'volume_size': 1, 'image_id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97ea3c0e222acce7df9a5f40bd56e244', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0abf771377f4456099e969318f412198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65b0f95a0777d560f6b0168360e6bdc0da6bea7aa94ce479a028d2555d40a2b4691f29c03c57121e05141652cecd8aff8c08bd5590438b003d7493b3ef1be536', 'id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'created_at': datetime.datetime(2026, 9, 11, 12, 5, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 5, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8274d517-9f68-424b-be45-c58246ece9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8274d517-9f68-424b-be45-c58246ece9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b594c4f-5322-4546-9735-791ec9820b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Volume 9e89f640-2928-4ac0-93f9-6583b32ed5f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3', 'volume_size': 1, 'image_id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97ea3c0e222acce7df9a5f40bd56e244', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0abf771377f4456099e969318f412198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65b0f95a0777d560f6b0168360e6bdc0da6bea7aa94ce479a028d2555d40a2b4691f29c03c57121e05141652cecd8aff8c08bd5590438b003d7493b3ef1be536', 'id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'created_at': datetime.datetime(2026, 9, 11, 12, 5, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 5, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Trying to clone 9e89f640-2928-4ac0-93f9-6583b32ed5f3 from image cf6fb891-5706-4889-90a7-8ab387e1c1e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 14:05:49 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Image download 0.00 MB at 0.00 MB/s Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54ed17b-2bb8-4870-a6dd-0aeec8a423fb]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:49 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD Sep 11 14:05:49 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:50 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:50 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD Sep 11 14:05:50 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:50 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD" returned: 1 in 0.449s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Temporary image cf6fb891-5706-4889-90a7-8ab387e1c1e6 is fetched for user cf9f3b00acef44c380b51594500d6c63. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591626e-be9d-4855-a648-ed66a4f8747e]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:50 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD Sep 11 14:05:50 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:51 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:51 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD Sep 11 14:05:51 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:51 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD" returned: 1 in 0.335s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e89f640-2928-4ac0-93f9-6583b32ed5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abf771377f4456099e969318f412198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:05:49Z,use_quota=True,user_id='cf9f3b00acef44c380b51594500d6c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec03ce0-3ee4-4536-9741-ddf671631a55),volume_type_id=fec03ce0-3ee4-4536-9741-ddf671631a55)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Creating volume 9e89f640-2928-4ac0-93f9-6583b32ed5f3 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:05:51 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:05:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:51 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 1073741824 Sep 11 14:05:51 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:52 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 1073741824" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:52 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 Sep 11 14:05:52 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:52 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Attempting download of cf6fb891-5706-4889-90a7-8ab387e1c1e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'metadata': {}}])) to volume 9e89f640-2928-4ac0-93f9-6583b32ed5f3. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa8e95-7416-487b-a51c-0fde66d18ef5]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:52 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3 Sep 11 14:05:52 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:52 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3" returned: 0 in 0.325s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:52 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3 Sep 11 14:05:52 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-a635b746-e81a-421a-a8b2-558e23035cda-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Lock "cinder-a635b746-e81a-421a-a8b2-558e23035cda-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Acquiring lock "cinder-quobyte-a635b746-e81a-421a-a8b2-558e23035cda" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-a635b746-e81a-421a-a8b2-558e23035cda" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa5b547-9e25-4adc-b3de-afc91053fd81]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:53 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3" returned: 1 in 0.362s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6fb891-5706-4889-90a7-8ab387e1c1e6_peihi9q3' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bd113c-f889-4131-b237-ed05cb1b268b]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:53 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda Sep 11 14:05:53 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:53 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD Sep 11 14:05:53 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:53 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:53 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:53 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda Sep 11 14:05:53 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:53 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD Sep 11 14:05:53 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:53 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a635b746-e81a-421a-a8b2-558e23035cda" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Lock "cinder-quobyte-a635b746-e81a-421a-a8b2-558e23035cda" released by "delete_volume" :: held 0.706s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Created reservations ['22776c2d-e41f-4cdd-8db7-0c4a3f188bfd', '7f8fe448-2716-4b9b-a863-0e527acfa9d7', '22924e36-934e-487d-963f-a065f58ce15d', 'd37e496b-dce8-4364-a598-21995b4a7491'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:05:53 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD" returned: 1 in 0.330s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] cf6fb891-5706-4889-90a7-8ab387e1c1e6 was raw, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:53 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 Sep 11 14:05:53 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:53 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:05:53 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:54 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:05:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Deleted volume successfully. Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0aef4150-0ddf-4c75-bc65-6b2e521fde80 tempest-TestStampPattern-1770690345 None] Lock "cinder-a635b746-e81a-421a-a8b2-558e23035cda-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:54 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3" returned: 0 in 0.469s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6fb891-5706-4889-90a7-8ab387e1c1e6_2w_uw8y_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:05:54 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:54 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 1G Sep 11 14:05:54 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:54 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 1G" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Downloaded image cf6fb891-5706-4889-90a7-8ab387e1c1e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'metadata': {}}])) to volume 9e89f640-2928-4ac0-93f9-6583b32ed5f3 successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Temporary image cf6fb891-5706-4889-90a7-8ab387e1c1e6 for user cf9f3b00acef44c380b51594500d6c63 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Marking volume 9e89f640-2928-4ac0-93f9-6583b32ed5f3 as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Copying metadata from image cf6fb891-5706-4889-90a7-8ab387e1c1e6 to 9e89f640-2928-4ac0-93f9-6583b32ed5f3. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Creating volume glance metadata for volume 9e89f640-2928-4ac0-93f9-6583b32ed5f3 backed by image cf6fb891-5706-4889-90a7-8ab387e1c1e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '97ea3c0e222acce7df9a5f40bd56e244', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b594c4f-5322-4546-9735-791ec9820b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3', 'volume_size': 1, 'image_id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97ea3c0e222acce7df9a5f40bd56e244', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0abf771377f4456099e969318f412198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '65b0f95a0777d560f6b0168360e6bdc0da6bea7aa94ce479a028d2555d40a2b4691f29c03c57121e05141652cecd8aff8c08bd5590438b003d7493b3ef1be536', 'id': 'cf6fb891-5706-4889-90a7-8ab387e1c1e6', 'created_at': datetime.datetime(2026, 9, 11, 12, 5, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 5, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6fb891-5706-4889-90a7-8ab387e1c1e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b224b4-6289-47a9-ae5f-0d8ce7b0d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:05:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Volume volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 (9e89f640-2928-4ac0-93f9-6583b32ed5f3): created successfully Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b224b4-6289-47a9-ae5f-0d8ce7b0d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:05:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Flow 'volume_create_manager' (5248c4de-57f9-496e-848a-149d766faba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:05:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-438ed076-c553-4d09-939a-f22af4a31874 tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Created volume successfully. Sep 11 14:05:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Acquiring lock "cinder-9e89f640-2928-4ac0-93f9-6583b32ed5f3-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "cinder-9e89f640-2928-4ac0-93f9-6583b32ed5f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Acquiring lock "cinder-quobyte-9e89f640-2928-4ac0-93f9-6583b32ed5f3" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:05:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "cinder-quobyte-9e89f640-2928-4ac0-93f9-6583b32ed5f3" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:05:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a7c8c-80a4-4077-a3e8-b06efe9adbd6]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:05:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:55 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 Sep 11 14:05:55 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:56 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3" returned: 0 in 0.395s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:56 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3 Sep 11 14:05:56 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:56 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9e89f640-2928-4ac0-93f9-6583b32ed5f3" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "cinder-quobyte-9e89f640-2928-4ac0-93f9-6583b32ed5f3" released by "delete_volume" :: held 0.705s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:05:56 devstack cinder-volume[88731]: WARNING cinder.quota [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:05:56 devstack cinder-volume[88731]: WARNING cinder.quota [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Created reservations ['5ef05824-d991-4fbc-ae71-17ac205e7e44', '676c5380-0c00-47ce-90e1-e7ff058f4621', 'ee732608-0a45-45d3-bf97-65a5ade67995', '9a505db1-2e8c-4fca-a977-68e820134a4e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:05:56 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:05:56 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:05:56 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:05:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Deleted volume successfully. Sep 11 14:05:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-24873eb2-438a-492c-9267-1937e4366e2a tempest-VolumeAndVolumeTypeFromImageTest-1783126850 None] Lock "cinder-9e89f640-2928-4ac0-93f9-6583b32ed5f3-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (92ac6cd4-2aea-452c-91d4-54effbd89c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46822c12-6b7e-4c4e-9923-25e2c7309293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46822c12-6b7e-4c4e-9923-25e2c7309293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-742486915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5816d682-6151-4d46-9ff2-f609aeb6097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:01Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee6acfe-868b-4fb1-96a7-e24ef22ab57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee6acfe-868b-4fb1-96a7-e24ef22ab57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf28da2f-3490-47c3-9733-63bffc522693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf28da2f-3490-47c3-9733-63bffc522693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5816d682-6151-4d46-9ff2-f609aeb6097c', 'volume_name': 'volume-5816d682-6151-4d46-9ff2-f609aeb6097c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dba40b-476b-41a3-a1f4-c0747951071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dba40b-476b-41a3-a1f4-c0747951071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7576d6d9-f286-4771-b315-d66264eeb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:01 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume 5816d682-6151-4d46-9ff2-f609aeb6097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5816d682-6151-4d46-9ff2-f609aeb6097c', 'volume_size': 1} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-742486915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5816d682-6151-4d46-9ff2-f609aeb6097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:01Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating volume 5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:01 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:01 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c 1073741824 Sep 11 14:06:01 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:01 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c 1073741824" returned: 0 in 0.383s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:01 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c Sep 11 14:06:01 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:02 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c" returned: 0 in 0.274s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7576d6d9-f286-4771-b315-d66264eeb31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5816d682-6151-4d46-9ff2-f609aeb6097c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04aed01-9998-41ad-bf4a-81190dc26e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:02 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume volume-5816d682-6151-4d46-9ff2-f609aeb6097c (5816d682-6151-4d46-9ff2-f609aeb6097c): created successfully Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04aed01-9998-41ad-bf4a-81190dc26e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (92ac6cd4-2aea-452c-91d4-54effbd89c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-79081100-6c66-473b-b969-3abccbb1ffdd tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created volume successfully. Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating offline snapshot 96008e3a-409b-4310-992f-83d721444632 of volume 5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e6d1aa-eb46-4d32-8311-26241e702b44]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:02 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c Sep 11 14:06:02 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:03 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c" returned: 0 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:03 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 1G Sep 11 14:06:03 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:03 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 1G" returned: 0 in 0.420s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5816d682-6151-4d46-9ff2-f609aeb6097c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:03 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5816d682-6151-4d46-9ff2-f609aeb6097c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 Sep 11 14:06:03 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:03 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5816d682-6151-4d46-9ff2-f609aeb6097c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:03 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 is being set with open permissions: ugo+rw Sep 11 14:06:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:03 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 Sep 11 14:06:03 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:04 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632" returned: 0 in 0.279s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:04 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info Sep 11 14:06:04 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:04 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:04 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info is being set with open permissions: ugo+rw Sep 11 14:06:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:04 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info Sep 11 14:06:04 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:04 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.info" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:04 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-84a5fbe5-f01a-491a-8217-b424dfdc45a3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Create snapshot completed successfully Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (e63874d8-4a13-4b0a-b7c4-93b46076f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6307a47e-67cd-4204-9126-ac42f69a5c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6307a47e-67cd-4204-9126-ac42f69a5c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680396058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f036af-4e6c-4bb4-a6bf-2d6222debce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:06Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf475bf6-7f37-461a-9410-785bc29f8851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf475bf6-7f37-461a-9410-785bc29f8851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f286ba0-d9b0-47d1-87f8-a271731885aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f286ba0-d9b0-47d1-87f8-a271731885aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f036af-4e6c-4bb4-a6bf-2d6222debce8', 'volume_name': 'volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7376bf2e-9403-4f49-9fef-1dd1f31bc7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7376bf2e-9403-4f49-9fef-1dd1f31bc7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d4c118-f845-43f8-af94-7478dce4178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume f0f036af-4e6c-4bb4-a6bf-2d6222debce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8', 'volume_size': 1} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680396058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f036af-4e6c-4bb4-a6bf-2d6222debce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:06Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating volume f0f036af-4e6c-4bb4-a6bf-2d6222debce8 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:06 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:06 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 1073741824 Sep 11 14:06:06 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (f3c04c92-07c8-4917-b46d-25f775e673a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b6f082-977d-47f3-b44d-06d18a5bbd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b6f082-977d-47f3-b44d-06d18a5bbd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992603684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:07Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa63804-f489-4492-929c-b7abfd3c1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa63804-f489-4492-929c-b7abfd3c1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b153dda3-6390-4cf0-8116-17ea4e0e825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b153dda3-6390-4cf0-8116-17ea4e0e825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88', 'volume_name': 'volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce9040e-fe2d-46a1-9de2-2100bf1e9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce9040e-fe2d-46a1-9de2-2100bf1e9d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca032dc-5461-4618-aa3d-64e7ae4716b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88', 'volume_size': 1} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:06 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 1073741824" returned: 0 in 0.559s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:06 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 Sep 11 14:06:06 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (83ab9adf-5c65-44fe-9608-83e58b998f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:07 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8010b83-1026-4591-a9cb-e3ec051b5199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8" returned: 0 in 0.334s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1992603684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:07Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating volume bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:07 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8010b83-1026-4591-a9cb-e3ec051b5199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-272848947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b3b93c-7968-4215-b05d-076b260551b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:07Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac0faec-f81e-47b7-8709-271dd8a00c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac0faec-f81e-47b7-8709-271dd8a00c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42366b7-5637-43f7-b659-7e59aba87ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 1073741824 Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42366b7-5637-43f7-b659-7e59aba87ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b3b93c-7968-4215-b05d-076b260551b7', 'volume_name': 'volume-a4b3b93c-7968-4215-b05d-076b260551b7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2457300-6364-4f9d-8475-41ab538c78fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2457300-6364-4f9d-8475-41ab538c78fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c054a0c-8d23-424e-8488-351b2488cf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume a4b3b93c-7968-4215-b05d-076b260551b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b3b93c-7968-4215-b05d-076b260551b7', 'volume_size': 1} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d4c118-f845-43f8-af94-7478dce4178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c225f924-78c2-46ec-9e52-0c34d643ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 (f0f036af-4e6c-4bb4-a6bf-2d6222debce8): created successfully Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c225f924-78c2-46ec-9e52-0c34d643ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (e63874d8-4a13-4b0a-b7c4-93b46076f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a15acf9b-ca1d-460f-9706-32a4e6be51c3 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created volume successfully. Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (b808f2d4-1e3b-42e7-b5cc-46e05da050dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff39f55-a744-46d8-9503-e0e8b7043dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff39f55-a744-46d8-9503-e0e8b7043dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-993254068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a65b54-f51b-4324-93f1-63c24d91c9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:08Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabce893-e315-4e3a-bdf9-9f031ab8eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabce893-e315-4e3a-bdf9-9f031ab8eea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0f8c32-c3aa-4577-b7f8-7aadc1a36e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0f8c32-c3aa-4577-b7f8-7aadc1a36e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a65b54-f51b-4324-93f1-63c24d91c9fe', 'volume_name': 'volume-58a65b54-f51b-4324-93f1-63c24d91c9fe', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb1a591-8580-4bad-a96b-871831b81897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb1a591-8580-4bad-a96b-871831b81897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1a570d-d100-4dc4-93bb-28923e34f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume 58a65b54-f51b-4324-93f1-63c24d91c9fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a65b54-f51b-4324-93f1-63c24d91c9fe', 'volume_size': 1} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 1073741824" returned: 0 in 0.678s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:08 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 Sep 11 14:06:08 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (1d093dd7-1a40-49fb-aa05-1f481c2c0750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda1033b-367e-4831-84cc-b43dc90f0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda1033b-367e-4831-84cc-b43dc90f0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487500694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7d65c-4b92-4228-8b94-d2aed389cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:08Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85539953-6c0f-4e87-a0b4-0b692cdd5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85539953-6c0f-4e87-a0b4-0b692cdd5839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6e25e0-cbc7-4107-ae56-77138c692de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6e25e0-cbc7-4107-ae56-77138c692de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c7d65c-4b92-4228-8b94-d2aed389cf69', 'volume_name': 'volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e412500b-39cd-4c1f-b473-1ec1309802c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e412500b-39cd-4c1f-b473-1ec1309802c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fed17eb-6784-4cd7-945e-d864f98cf9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume e5c7d65c-4b92-4228-8b94-d2aed389cf69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69', 'volume_size': 1} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:08 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-272848947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b3b93c-7968-4215-b05d-076b260551b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:07Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating volume a4b3b93c-7968-4215-b05d-076b260551b7 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:08 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca032dc-5461-4618-aa3d-64e7ae4716b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:08 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 1073741824 Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5fe509-8945-4899-84e2-555ac6f46bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:08 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 (bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88): created successfully Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5fe509-8945-4899-84e2-555ac6f46bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (f3c04c92-07c8-4917-b46d-25f775e673a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-96368237-3de6-43f5-afe1-446cb0902a89 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created volume successfully. Sep 11 14:06:08 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 1073741824" returned: 0 in 0.451s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:08 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 Sep 11 14:06:08 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:09 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-993254068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a65b54-f51b-4324-93f1-63c24d91c9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:08Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating volume 58a65b54-f51b-4324-93f1-63c24d91c9fe {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:09 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c054a0c-8d23-424e-8488-351b2488cf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b3b93c-7968-4215-b05d-076b260551b7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b990d24-e091-4511-8dd8-0e5daa4b4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:09 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe 1073741824 Sep 11 14:06:09 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:09 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume volume-a4b3b93c-7968-4215-b05d-076b260551b7 (a4b3b93c-7968-4215-b05d-076b260551b7): created successfully Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b990d24-e091-4511-8dd8-0e5daa4b4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (83ab9adf-5c65-44fe-9608-83e58b998f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-807f5565-317b-4541-b82d-f005448b255f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created volume successfully. Sep 11 14:06:09 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe 1073741824" returned: 0 in 0.459s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:09 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe Sep 11 14:06:09 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:09 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe" returned: 0 in 0.240s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487500694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7d65c-4b92-4228-8b94-d2aed389cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee06399a6ef48fdbb95ca0319ba8b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:08Z,use_quota=True,user_id='2104682b6f964826866abf843d54ad99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Creating volume e5c7d65c-4b92-4228-8b94-d2aed389cf69 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:09 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1a570d-d100-4dc4-93bb-28923e34f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a65b54-f51b-4324-93f1-63c24d91c9fe', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:09 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 1073741824 Sep 11 14:06:09 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846b8b30-0d0b-4c53-a58a-31fe735796e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:09 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume volume-58a65b54-f51b-4324-93f1-63c24d91c9fe (58a65b54-f51b-4324-93f1-63c24d91c9fe): created successfully Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846b8b30-0d0b-4c53-a58a-31fe735796e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (b808f2d4-1e3b-42e7-b5cc-46e05da050dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-279c6764-d4d2-44a6-9570-cbfaf1e771f6 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created volume successfully. Sep 11 14:06:10 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 1073741824" returned: 0 in 0.432s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:10 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 Sep 11 14:06:10 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:10 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fed17eb-6784-4cd7-945e-d864f98cf9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2ecb25-3a06-41fd-b46b-5d959d6ec605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Volume volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 (e5c7d65c-4b92-4228-8b94-d2aed389cf69): created successfully Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2ecb25-3a06-41fd-b46b-5d959d6ec605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Flow 'volume_create_manager' (1d093dd7-1a40-49fb-aa05-1f481c2c0750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:10 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:10 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3478f431-e157-4673-a7f9-b0ea230d90c0 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created volume successfully. Sep 11 14:06:10 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:06:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-e5c7d65c-4b92-4228-8b94-d2aed389cf69-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-e5c7d65c-4b92-4228-8b94-d2aed389cf69-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (0f7763bf-eff6-4408-88fa-100d1e373052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5edae33-034d-4654-91d1-f9acc6fbb2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-e5c7d65c-4b92-4228-8b94-d2aed389cf69" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5edae33-034d-4654-91d1-f9acc6fbb2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423409972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b533351-3b1a-49d4-8574-e3ef58b70d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:11Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b751424e-930f-435c-8c00-96beb2a12bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b751424e-930f-435c-8c00-96beb2a12bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34a7ecd-467e-4672-9206-8cb1ca95ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34a7ecd-467e-4672-9206-8cb1ca95ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b533351-3b1a-49d4-8574-e3ef58b70d4e', 'volume_name': 'volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384433d4-23e4-4f28-a4bf-17f0af3abbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384433d4-23e4-4f28-a4bf-17f0af3abbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39579c78-4a73-4358-bdc0-b77409a40d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:11 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Volume 7b533351-3b1a-49d4-8574-e3ef58b70d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e', 'volume_size': 1} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423409972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b533351-3b1a-49d4-8574-e3ef58b70d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:11Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Creating volume 7b533351-3b1a-49d4-8574-e3ef58b70d4e {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:11 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-e5c7d65c-4b92-4228-8b94-d2aed389cf69" acquired by "delete_volume" :: waited 0.081s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:11 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e 1073741824 Sep 11 14:06:11 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[871d82fc-5fb1-4010-889e-2547463f7141]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:11 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 Sep 11 14:06:11 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:12 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69" returned: 0 in 0.376s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:12 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e 1073741824" returned: 0 in 0.455s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:12 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69 Sep 11 14:06:12 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:12 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e Sep 11 14:06:12 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:12 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e5c7d65c-4b92-4228-8b94-d2aed389cf69" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-e5c7d65c-4b92-4228-8b94-d2aed389cf69" released by "delete_volume" :: held 0.678s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:12 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39579c78-4a73-4358-bdc0-b77409a40d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb5b69a-0e4c-4c75-82c7-b8bcefe33028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['044a2c9f-fd0e-4499-b087-a04c51568c5c', 'cc0d61cb-7294-44db-a503-614be79eb69a', 'a9bf9127-a28e-42ad-bd18-9782002260e4', '50495078-7212-4da1-b2d6-1c9e90119b65'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:12 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Volume volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e (7b533351-3b1a-49d4-8574-e3ef58b70d4e): created successfully Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb5b69a-0e4c-4c75-82c7-b8bcefe33028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (0f7763bf-eff6-4408-88fa-100d1e373052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f9bb7a0d-71a1-4c4e-9780-120dc03aaeb6 tempest-ProjectReaderTests-1859406839 None] Created volume successfully. Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:12 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:12 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-7b533351-3b1a-49d4-8574-e3ef58b70d4e-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-7b533351-3b1a-49d4-8574-e3ef58b70d4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:12 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-quobyte-7b533351-3b1a-49d4-8574-e3ef58b70d4e" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleted volume successfully. Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-7b533351-3b1a-49d4-8574-e3ef58b70d4e" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c22a799-6bef-4c72-8715-a88abbe5105c tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-e5c7d65c-4b92-4228-8b94-d2aed389cf69-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[337583e7-2eb7-4acd-a5ca-a26fefc892c9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-58a65b54-f51b-4324-93f1-63c24d91c9fe-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:12 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-58a65b54-f51b-4324-93f1-63c24d91c9fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:12 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-58a65b54-f51b-4324-93f1-63c24d91c9fe" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-58a65b54-f51b-4324-93f1-63c24d91c9fe" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b670d9-2ee1-4a5c-8c7f-9e9c2e24ab11]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:13 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe Sep 11 14:06:13 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:13 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e" returned: 0 in 0.406s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:13 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e Sep 11 14:06:13 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:13 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:13 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe Sep 11 14:06:13 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:13 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b533351-3b1a-49d4-8574-e3ef58b70d4e" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-7b533351-3b1a-49d4-8574-e3ef58b70d4e" released by "delete_volume" :: held 0.713s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Created reservations ['31bf0158-4559-4fc0-8b8a-42ed7772bcdd', 'b026d7a8-7a7e-40d0-b8c1-261cf56c85fe', '04fe459d-4ff3-44e2-b099-f5f9495a6610', '5f6febaf-c424-4621-bf1b-2ae734df245b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:13 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:13 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:13 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-58a65b54-f51b-4324-93f1-63c24d91c9fe" returned: 0 in 0.261s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-58a65b54-f51b-4324-93f1-63c24d91c9fe" released by "delete_volume" :: held 0.680s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['34311fb9-f536-48c9-bef6-8fd6051d524b', '86f39994-e0f4-4d67-a386-31e804294387', '4e3c3e53-eb7e-469e-9c58-355dd7664c67', '806ec379-740c-4120-979f-82e1fd760d69'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:13 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:13 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:13 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Deleted volume successfully. Sep 11 14:06:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ebddb972-3957-464f-bb3f-c9e9287f1818 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-7b533351-3b1a-49d4-8574-e3ef58b70d4e-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:14 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleted volume successfully. Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-a4b3b93c-7968-4215-b05d-076b260551b7-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-a4b3b93c-7968-4215-b05d-076b260551b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7373d3d2-509d-41a9-bd87-81bbabc4f03e tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-58a65b54-f51b-4324-93f1-63c24d91c9fe-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-a4b3b93c-7968-4215-b05d-076b260551b7" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-a4b3b93c-7968-4215-b05d-076b260551b7" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efe1f1-8585-4c1a-8642-f27c211cac90]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:14 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 Sep 11 14:06:14 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (ec3d073e-df1f-45d3-bb49-57ec8674e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e470cf19-c1f6-444b-bd99-67ac2df982e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e470cf19-c1f6-444b-bd99-67ac2df982e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659844342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f27787d-8d0d-4ddb-a833-3f8bf39556ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:14Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756e2b44-8288-42a0-868c-03b266233151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756e2b44-8288-42a0-868c-03b266233151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574c77a5-bfd4-4db3-b21b-f6444ed78cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574c77a5-bfd4-4db3-b21b-f6444ed78cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f27787d-8d0d-4ddb-a833-3f8bf39556ee', 'volume_name': 'volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee72f7a-aa29-4be8-9d1d-12407fe5c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee72f7a-aa29-4be8-9d1d-12407fe5c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea9eecb-2605-4004-9c17-72fc6d07e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Volume 3f27787d-8d0d-4ddb-a833-3f8bf39556ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee', 'volume_size': 1} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659844342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f27787d-8d0d-4ddb-a833-3f8bf39556ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:14Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Creating volume 3f27787d-8d0d-4ddb-a833-3f8bf39556ee {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:14 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:14 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee 1073741824 Sep 11 14:06:14 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:14 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7" returned: 0 in 0.367s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:14 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7 Sep 11 14:06:14 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:14 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a4b3b93c-7968-4215-b05d-076b260551b7" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:14 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee 1073741824" returned: 0 in 0.420s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-a4b3b93c-7968-4215-b05d-076b260551b7" released by "delete_volume" :: held 0.679s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:14 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee Sep 11 14:06:14 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['5b85482d-b85f-4ef5-9a55-4f4763597eea', '8846c3b4-7aa6-421c-9fd1-775d57de6ef2', '7e6b29df-3a83-4c27-b823-2b0007b563d2', 'dd51ecca-36b9-4688-b6a4-9c701016f6f3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:14 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:14 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:15 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea9eecb-2605-4004-9c17-72fc6d07e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f6e539-d61e-455d-a2bb-43899617dd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:15 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Volume volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee (3f27787d-8d0d-4ddb-a833-3f8bf39556ee): created successfully Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f6e539-d61e-455d-a2bb-43899617dd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (ec3d073e-df1f-45d3-bb49-57ec8674e041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:15 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8dee2b07-5416-4616-80fb-c7f019d881ba tempest-ProjectReaderTests-1859406839 None] Created volume successfully. Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.243s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleted volume successfully. Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-61eee500-d13b-4f1f-b4fc-bd319c0f6a7f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-a4b3b93c-7968-4215-b05d-076b260551b7-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88" acquired by "delete_volume" :: waited 0.013s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[396e3552-facc-4a70-8de0-a677fd21bd78]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-3f27787d-8d0d-4ddb-a833-3f8bf39556ee-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-3f27787d-8d0d-4ddb-a833-3f8bf39556ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-quobyte-3f27787d-8d0d-4ddb-a833-3f8bf39556ee" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-3f27787d-8d0d-4ddb-a833-3f8bf39556ee" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:15 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 Sep 11 14:06:15 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac664c7-7383-42d4-bb88-2b9442206ab2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:15 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee Sep 11 14:06:15 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:15 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88" returned: 0 in 0.393s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:15 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88 Sep 11 14:06:15 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:15 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee" returned: 0 in 0.370s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:15 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee Sep 11 14:06:15 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:15 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88" released by "delete_volume" :: held 0.703s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['d9013f42-d010-4ebc-9d88-4f5eb7abaa30', '9739b2ca-171c-4c82-858e-43107a8f5668', '28159d5a-8643-4b3a-b5b7-b774bb2ccdce', '8efd2982-29d6-4c9a-8b40-4cd884c6cb22'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:16 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3f27787d-8d0d-4ddb-a833-3f8bf39556ee" returned: 0 in 0.268s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-3f27787d-8d0d-4ddb-a833-3f8bf39556ee" released by "delete_volume" :: held 0.680s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:16 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:16 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Created reservations ['4e147743-b4c5-4013-9ae4-35af0de7c4e9', '78d6353f-2c4c-484f-985d-4162fe5c12c6', 'f5236efa-ada4-4698-b9b1-45ba3ef7500f', '37a8454b-1a3f-44ce-b96b-434fd1f06473'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:16 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:16 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:16 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-f0f036af-4e6c-4bb4-a6bf-2d6222debce8-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleted volume successfully. Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-f0f036af-4e6c-4bb4-a6bf-2d6222debce8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b4a34026-03b7-4b49-9c39-03decc2fcc97 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-bc01f9a4-4821-4b77-b5a7-1b4ee5d3ba88-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-f0f036af-4e6c-4bb4-a6bf-2d6222debce8" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-f0f036af-4e6c-4bb4-a6bf-2d6222debce8" acquired by "delete_volume" :: waited 0.013s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:16 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.301s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Deleted volume successfully. Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c3472-e801-4e34-b5ea-0aafcd6efe8d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f6d9fb00-27f1-4afc-8a1e-bd1eeba57221 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-3f27787d-8d0d-4ddb-a833-3f8bf39556ee-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:16 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 Sep 11 14:06:16 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:16 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8" returned: 0 in 0.383s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:16 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8 Sep 11 14:06:16 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (51b6f706-11d4-46c7-9e86-1f47129cbe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322e5542-3d2c-4aee-ab74-2c3f9d05efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322e5542-3d2c-4aee-ab74-2c3f9d05efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-632994904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cc6f6f-d97a-4f34-b162-7700a0782255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:17Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663de01d-c082-4116-9db8-cc08699df32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663de01d-c082-4116-9db8-cc08699df32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c72248-7d20-4df2-94b9-85b7dac90262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c72248-7d20-4df2-94b9-85b7dac90262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80cc6f6f-d97a-4f34-b162-7700a0782255', 'volume_name': 'volume-80cc6f6f-d97a-4f34-b162-7700a0782255', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c49f511-6e5f-4459-8cd9-4941c0ee329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c49f511-6e5f-4459-8cd9-4941c0ee329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95901000-0856-424b-8326-5ab227a0e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:17 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Volume 80cc6f6f-d97a-4f34-b162-7700a0782255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80cc6f6f-d97a-4f34-b162-7700a0782255', 'volume_size': 1} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-632994904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cc6f6f-d97a-4f34-b162-7700a0782255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:17Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Creating volume 80cc6f6f-d97a-4f34-b162-7700a0782255 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:17 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:17 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 1073741824 Sep 11 14:06:17 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:17 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f0f036af-4e6c-4bb4-a6bf-2d6222debce8" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-f0f036af-4e6c-4bb4-a6bf-2d6222debce8" released by "delete_volume" :: held 0.689s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['8f23359d-f052-4c5b-ad70-cbaa3b526bb0', 'b4864eb7-9897-40c3-b894-626497db89f8', 'b30d19ce-135f-4a2c-bd31-3722a0368271', 'de5c2256-98f5-4fe5-9622-a87ed2a6c0db'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:17 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:17 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:17 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 1073741824" returned: 0 in 0.427s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:17 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 Sep 11 14:06:17 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-96008e3a-409b-4310-992f-83d721444632-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:17 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.272s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleted volume successfully. Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-96008e3a-409b-4310-992f-83d721444632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-5816d682-6151-4d46-9ff2-f609aeb6097c" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dab67c3e-a887-4b8d-9b87-68accfee5f33 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-f0f036af-4e6c-4bb4-a6bf-2d6222debce8-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-5816d682-6151-4d46-9ff2-f609aeb6097c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-96008e3a-409b-4310-992f-83d721444632" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-96008e3a-409b-4310-992f-83d721444632" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleting offline snapshot 96008e3a-409b-4310-992f-83d721444632 of volume 5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] snapshot_file for this snap is: volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a32480-fcb4-449f-8a44-530ce76641fe]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:17 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 Sep 11 14:06:17 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:17 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255" returned: 0 in 0.276s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95901000-0856-424b-8326-5ab227a0e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80cc6f6f-d97a-4f34-b162-7700a0782255', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ceb442-e7fc-4a50-aa63-5d57d9aafc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:17 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Volume volume-80cc6f6f-d97a-4f34-b162-7700a0782255 (80cc6f6f-d97a-4f34-b162-7700a0782255): created successfully Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ceb442-e7fc-4a50-aa63-5d57d9aafc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (51b6f706-11d4-46c7-9e86-1f47129cbe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-685968e1-7395-4f9d-b815-aff1298c8640 tempest-ProjectReaderTests-1859406839 None] Created volume successfully. Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-80cc6f6f-d97a-4f34-b162-7700a0782255-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:18 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-80cc6f6f-d97a-4f34-b162-7700a0782255-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632" returned: 0 in 0.398s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5816d682-6151-4d46-9ff2-f609aeb6097c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3f2ff2-67c7-4ca0-907d-8b12d07f8682]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-quobyte-80cc6f6f-d97a-4f34-b162-7700a0782255" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-80cc6f6f-d97a-4f34-b162-7700a0782255" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb15fcd3-995e-4ff3-8c73-5d7e1793f191]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:18 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c Sep 11 14:06:18 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:18 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 Sep 11 14:06:18 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:18 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c" returned: 0 in 0.362s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:18 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 Sep 11 14:06:18 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:18 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255" returned: 0 in 0.362s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:18 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255 Sep 11 14:06:18 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:18 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-80cc6f6f-d97a-4f34-b162-7700a0782255" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-80cc6f6f-d97a-4f34-b162-7700a0782255" released by "delete_volume" :: held 0.646s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:18 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=120,cinder:UPDATE=143,cinder:INSERT=32,cinder:DELETE=9 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632" returned: 0 in 0.335s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=120,cinder:UPDATE=137,cinder:INSERT=41,cinder:DELETE=14 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:06:18 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632 Sep 11 14:06:18 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Created reservations ['a1c27c95-f62c-4c4c-a9ee-f2be5d5dca5f', 'd673cdf4-7060-42d0-886a-54ddb722b8e0', '5863e787-37e1-4c00-a6c3-9d681a7661c6', 'ce540bea-84e0-49c0-ae21-7e8380b6a436'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:19 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:19 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:19 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c.96008e3a-409b-4310-992f-83d721444632" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-96008e3a-409b-4310-992f-83d721444632" released by "_delete_snapshot" :: held 1.447s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-5816d682-6151-4d46-9ff2-f609aeb6097c" released by "delete_snapshot" :: held 1.467s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['bed57adb-0190-4c14-af7d-23fa5cad08af', 'd581cc78-ad38-4a43-ae06-41380e1becc9', 'bfd68ad5-20b2-45b6-a506-cbb5aee9a397', '4974f9d4-8ac9-4212-b7bc-76f34f85332a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:19 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Deleted volume successfully. Sep 11 14:06:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Delete snapshot completed successfully. Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9935c36d-df69-424d-b6c8-71c86659f163 tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-96008e3a-409b-4310-992f-83d721444632-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ae14107d-60b7-4b71-8bc5-282e4aa199f1 tempest-ProjectReaderTests-1859406839 None] Lock "cinder-80cc6f6f-d97a-4f34-b162-7700a0782255-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (3a5587d0-8514-47c6-91c6-7ac8a1bf15ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dc5e48-92b1-4f54-9542-02d27bf30f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dc5e48-92b1-4f54-9542-02d27bf30f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429415507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:20Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdde4f35-37fe-4f74-a518-baa793f526c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdde4f35-37fe-4f74-a518-baa793f526c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5137704-feee-44eb-8e8c-f17d5b86729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5137704-feee-44eb-8e8c-f17d5b86729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0', 'volume_name': 'volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b384608a-d297-44ce-9ffe-5614a5f82794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b384608a-d297-44ce-9ffe-5614a5f82794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cdbad8-4eae-4a29-9fb5-c85a6a60fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:19 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Volume 43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0', 'volume_size': 1} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429415507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5518c1999a4a5ca6c9910b4b83224a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:20Z,use_quota=True,user_id='f33b2f23794e41988d1834559b8537e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Creating volume 43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:19 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-5816d682-6151-4d46-9ff2-f609aeb6097c-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:19 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 1073741824 Sep 11 14:06:19 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-5816d682-6151-4d46-9ff2-f609aeb6097c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "cinder-quobyte-5816d682-6151-4d46-9ff2-f609aeb6097c" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-5816d682-6151-4d46-9ff2-f609aeb6097c" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e024bf21-43a1-48c5-afea-2d5ae0896df0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:20 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c Sep 11 14:06:20 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:20 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 1073741824" returned: 0 in 0.453s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:20 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 Sep 11 14:06:20 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:20 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c" returned: 0 in 0.402s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:20 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c Sep 11 14:06:20 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:20 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cdbad8-4eae-4a29-9fb5-c85a6a60fafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc32d44c-a6e9-4888-b946-0ab3d6db1810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:20 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Volume volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 (43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0): created successfully Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc32d44c-a6e9-4888-b946-0ab3d6db1810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Flow 'volume_create_manager' (3a5587d0-8514-47c6-91c6-7ac8a1bf15ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d477a0c3-b077-4718-ad62-3f9bbc3bbc2b tempest-ProjectReaderTests-1859406839 None] Created volume successfully. Sep 11 14:06:20 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5816d682-6151-4d46-9ff2-f609aeb6097c" returned: 0 in 0.266s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-quobyte-5816d682-6151-4d46-9ff2-f609aeb6097c" released by "delete_volume" :: held 0.725s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Created reservations ['003defce-9c28-4368-b75d-d5a1903f7d45', '746b855b-602d-4aa8-ad89-4249f319dae0', 'd715c34c-8981-4d4e-b085-c882c38c9a7c', 'd74f5840-71ce-4766-b686-2ec0e0c6f067'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:20 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:20 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Lock "cinder-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Acquiring lock "cinder-quobyte-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16cc853-ee12-43ff-a1d7-bfeec78b4eaf]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:20 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 Sep 11 14:06:20 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:20 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.290s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:20 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:20 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Deleted volume successfully. Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8af24594-ff7b-48f3-a433-946756d4665f tempest-CreateVolumesFromSnapshotTest-1972904421 None] Lock "cinder-5816d682-6151-4d46-9ff2-f609aeb6097c-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:21 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0" returned: 0 in 0.403s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:21 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0 Sep 11 14:06:21 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:21 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0" returned: 0 in 0.254s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Lock "cinder-quobyte-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0" released by "delete_volume" :: held 0.696s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Created reservations ['50adeafd-2ef1-4a0a-9a87-85ade2b7c478', 'ca1946ed-2f2d-43db-9273-d2c189bc421a', 'ff829ee7-721f-49c4-8c07-5e4e10c5cf63', '1461788b-853a-4daa-8ee2-616f2a233518'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:21 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:21 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:21 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Deleted volume successfully. Sep 11 14:06:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-394b1d7e-109e-48a1-b9f3-37777bfcfced tempest-ProjectReaderTests-1859406839 None] Lock "cinder-43cfa2e4-e660-40dd-b969-3eb8d6c6b3b0-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:23 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (ceb27da2-9bed-4b41-a2d2-d6f8010897e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083a3f0a-a9a2-4bbc-ac9e-4794e218afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083a3f0a-a9a2-4bbc-ac9e-4794e218afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930592850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cfb6bf-9052-4f77-9841-20952d4c0f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:24Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f77106-2f4b-481a-bdfa-a97a3544bdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f77106-2f4b-481a-bdfa-a97a3544bdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549ee9f1-54e1-4d6b-af03-1c1fe7167191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549ee9f1-54e1-4d6b-af03-1c1fe7167191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8cfb6bf-9052-4f77-9841-20952d4c0f34', 'volume_name': 'volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0c032-e968-4989-97fc-086bcaa8b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb0c032-e968-4989-97fc-086bcaa8b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792aa35b-b67a-491b-b8cd-13477860d358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:24 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume f8cfb6bf-9052-4f77-9841-20952d4c0f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34', 'volume_size': 1} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930592850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cfb6bf-9052-4f77-9841-20952d4c0f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:24Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Creating volume f8cfb6bf-9052-4f77-9841-20952d4c0f34 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:24 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:24 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 1073741824 Sep 11 14:06:24 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:24 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 1073741824" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:24 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 Sep 11 14:06:24 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:24 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34" returned: 0 in 0.247s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792aa35b-b67a-491b-b8cd-13477860d358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b25ca1-5c74-400d-a1b1-e8782dfaa4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:24 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 (f8cfb6bf-9052-4f77-9841-20952d4c0f34): created successfully Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b25ca1-5c74-400d-a1b1-e8782dfaa4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:24 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (ceb27da2-9bed-4b41-a2d2-d6f8010897e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:24 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6a90812a-2414-45ca-b435-065254970456 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created volume successfully. Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (4e68dac4-60b9-47cf-bf4f-aacc49cbefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b0beb0-47ac-43fd-868b-2fdd147b774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b0beb0-47ac-43fd-868b-2fdd147b774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954924726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55eb9f0e-d4cb-428c-9071-650bb825a1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:25Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b078931-1aea-4d70-b3b6-e7bf68feaa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b078931-1aea-4d70-b3b6-e7bf68feaa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb729e8b-29ea-4208-b5a6-a659415cbb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb729e8b-29ea-4208-b5a6-a659415cbb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55eb9f0e-d4cb-428c-9071-650bb825a1e1', 'volume_name': 'volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dacc2e-8275-4b25-8f14-c1effd8fe7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dacc2e-8275-4b25-8f14-c1effd8fe7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fa9a52-fd75-4646-9003-30cad71a1f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume 55eb9f0e-d4cb-428c-9071-650bb825a1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1', 'volume_size': 1} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954924726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55eb9f0e-d4cb-428c-9071-650bb825a1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:25Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Creating volume 55eb9f0e-d4cb-428c-9071-650bb825a1e1 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:25 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:25 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 1073741824 Sep 11 14:06:25 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (2db37a76-cc1c-4eff-a197-db226bbe26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657ad09b-937a-46f7-bca4-dd50e4893498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657ad09b-937a-46f7-bca4-dd50e4893498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733121309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbe02dc-41eb-40a8-a201-6837311fb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:26Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d46a24-de5c-45b2-89b9-7f5ea0ad0b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d46a24-de5c-45b2-89b9-7f5ea0ad0b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3607c1c2-6449-41cf-9cf4-a57af1b9b594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3607c1c2-6449-41cf-9cf4-a57af1b9b594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbe02dc-41eb-40a8-a201-6837311fb04b', 'volume_name': 'volume-5fbe02dc-41eb-40a8-a201-6837311fb04b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41845fd2-6be2-4978-9d50-4714c1dd5d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41845fd2-6be2-4978-9d50-4714c1dd5d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a315429b-c57b-47d3-af85-7c971f956825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume 5fbe02dc-41eb-40a8-a201-6837311fb04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbe02dc-41eb-40a8-a201-6837311fb04b', 'volume_size': 1} Sep 11 14:06:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:26 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 1073741824" returned: 0 in 0.474s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:26 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 Sep 11 14:06:26 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (8cb89c08-1ba9-4d0f-a6fe-44a596d0c783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8584533c-8271-4def-89ee-1272eaa1895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8584533c-8271-4def-89ee-1272eaa1895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474099237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ab9193-6d25-495e-bbea-b8cff9e225fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:26Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11421f8c-0077-4dde-9b21-01940c1d46de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11421f8c-0077-4dde-9b21-01940c1d46de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d13eb2-20b4-4a7e-ae12-d2e1600eb704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d13eb2-20b4-4a7e-ae12-d2e1600eb704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ab9193-6d25-495e-bbea-b8cff9e225fa', 'volume_name': 'volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe79766-03c6-4a86-b623-247c9ba12663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe79766-03c6-4a86-b623-247c9ba12663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1cec2b-d435-4514-bd08-3ee840ea2d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume a9ab9193-6d25-495e-bbea-b8cff9e225fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa', 'volume_size': 1} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:26 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733121309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbe02dc-41eb-40a8-a201-6837311fb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:26Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Creating volume 5fbe02dc-41eb-40a8-a201-6837311fb04b {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:26 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fa9a52-fd75-4646-9003-30cad71a1f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b 1073741824 Sep 11 14:06:26 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cdab4a-189a-49e7-bdee-b9d526b997ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 (55eb9f0e-d4cb-428c-9071-650bb825a1e1): created successfully Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cdab4a-189a-49e7-bdee-b9d526b997ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (4e68dac4-60b9-47cf-bf4f-aacc49cbefac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:26 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5032ce6f-0f08-4337-b0e2-6e92e3929a3b tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created volume successfully. Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (deb63edd-a341-407a-a5b5-1d9f3517652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dea2382-97ad-4dd4-808b-3b4bcd48495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dea2382-97ad-4dd4-808b-3b4bcd48495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157610739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbab2ec6-ea35-4771-914a-5d72b43f3cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:26Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be49e1a-82ba-4ee8-91b9-4167effd03bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be49e1a-82ba-4ee8-91b9-4167effd03bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f88fdf5-8d68-4a05-abdc-6be3d177698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f88fdf5-8d68-4a05-abdc-6be3d177698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbab2ec6-ea35-4771-914a-5d72b43f3cb3', 'volume_name': 'volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6367458c-a6e9-454c-b509-4acf1e47a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6367458c-a6e9-454c-b509-4acf1e47a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ff13dc-c905-454e-9d24-c0e2d91a811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume fbab2ec6-ea35-4771-914a-5d72b43f3cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3', 'volume_size': 1} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:26 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (84d6b05e-1061-4555-902b-39305e204ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a754cde-9ab2-472d-ad2b-60444b020e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b 1073741824" returned: 0 in 0.554s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a754cde-9ab2-472d-ad2b-60444b020e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987050887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0ab4db-9f0e-40bf-a298-48cb0a955b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:27Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5204b76-f655-4fb9-b496-3da13d6f5153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5204b76-f655-4fb9-b496-3da13d6f5153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802b425c-8503-48d0-b354-4cff6f1c446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802b425c-8503-48d0-b354-4cff6f1c446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0ab4db-9f0e-40bf-a298-48cb0a955b96', 'volume_name': 'volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ec51da-06de-40e9-9da8-bb4f39320309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ec51da-06de-40e9-9da8-bb4f39320309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55809710-3c10-402c-9450-3536c8018cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume 6b0ab4db-9f0e-40bf-a298-48cb0a955b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96', 'volume_size': 1} Sep 11 14:06:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:27 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b Sep 11 14:06:27 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:27 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b" returned: 0 in 0.243s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474099237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ab9193-6d25-495e-bbea-b8cff9e225fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:26Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Creating volume a9ab9193-6d25-495e-bbea-b8cff9e225fa {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:27 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a315429b-c57b-47d3-af85-7c971f956825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbe02dc-41eb-40a8-a201-6837311fb04b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:27 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa 1073741824 Sep 11 14:06:27 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5b603c-70dd-477d-a2ca-98eb884a4259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:27 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume volume-5fbe02dc-41eb-40a8-a201-6837311fb04b (5fbe02dc-41eb-40a8-a201-6837311fb04b): created successfully Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5b603c-70dd-477d-a2ca-98eb884a4259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (2db37a76-cc1c-4eff-a197-db226bbe26d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-49acba8e-30c2-414f-91ef-020fc1fe6a1c tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created volume successfully. Sep 11 14:06:27 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa 1073741824" returned: 0 in 0.407s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:27 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa Sep 11 14:06:27 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:27 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157610739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbab2ec6-ea35-4771-914a-5d72b43f3cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:26Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Creating volume fbab2ec6-ea35-4771-914a-5d72b43f3cb3 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:27 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1cec2b-d435-4514-bd08-3ee840ea2d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:27 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 1073741824 Sep 11 14:06:27 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06ab5a3-5a77-49dd-979e-8070e3092a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa (a9ab9193-6d25-495e-bbea-b8cff9e225fa): created successfully Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06ab5a3-5a77-49dd-979e-8070e3092a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (8cb89c08-1ba9-4d0f-a6fe-44a596d0c783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a6ec29da-997b-4a0a-8276-a9d4314676ee tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created volume successfully. Sep 11 14:06:28 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 1073741824" returned: 0 in 0.405s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:28 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 Sep 11 14:06:28 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:28 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987050887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0ab4db-9f0e-40bf-a298-48cb0a955b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569559710ee94d5183b0df32204bd33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:27Z,use_quota=True,user_id='a53b0f8ad7194535ab20b03466c41018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Creating volume 6b0ab4db-9f0e-40bf-a298-48cb0a955b96 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:28 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:28 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 1073741824 Sep 11 14:06:28 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ff13dc-c905-454e-9d24-c0e2d91a811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6757d464-6779-4c5b-88f9-855e0843b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 (fbab2ec6-ea35-4771-914a-5d72b43f3cb3): created successfully Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6757d464-6779-4c5b-88f9-855e0843b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (deb63edd-a341-407a-a5b5-1d9f3517652c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2d22c05b-0cf0-43c7-879d-88498b1b5dd0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created volume successfully. Sep 11 14:06:29 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 1073741824" returned: 0 in 0.436s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:29 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 Sep 11 14:06:29 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:29 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55809710-3c10-402c-9450-3536c8018cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5b9451-ad0d-4080-a84f-08b3366a091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Volume volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 (6b0ab4db-9f0e-40bf-a298-48cb0a955b96): created successfully Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5b9451-ad0d-4080-a84f-08b3366a091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Flow 'volume_create_manager' (84d6b05e-1061-4555-902b-39305e204ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7dddd579-519e-431b-bd60-9f33ddd952e0 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created volume successfully. Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-6b0ab4db-9f0e-40bf-a298-48cb0a955b96-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-6b0ab4db-9f0e-40bf-a298-48cb0a955b96-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-quobyte-6b0ab4db-9f0e-40bf-a298-48cb0a955b96" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-6b0ab4db-9f0e-40bf-a298-48cb0a955b96" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb3c418-1efd-44a3-b113-10ab138e24be]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:30 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 Sep 11 14:06:30 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:30 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:30 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96 Sep 11 14:06:30 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:30 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6b0ab4db-9f0e-40bf-a298-48cb0a955b96" returned: 0 in 0.236s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-6b0ab4db-9f0e-40bf-a298-48cb0a955b96" released by "delete_volume" :: held 0.619s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:30 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created reservations ['8d4f3f9c-759a-49f3-a6b0-1ebd00666d1d', 'ceb269a9-c65e-461e-b48f-2fca4e6c55e1', '215d9a2f-5c92-4201-9e2d-c7cdb514e7ea', 'a417740d-0cf5-48ff-a4b5-38b996162086'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:31 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:31 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:31 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Deleted volume successfully. Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-1e6699be-e3a3-4212-8d97-79c8ad23396d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-6b0ab4db-9f0e-40bf-a298-48cb0a955b96-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-fbab2ec6-ea35-4771-914a-5d72b43f3cb3-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-fbab2ec6-ea35-4771-914a-5d72b43f3cb3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-quobyte-fbab2ec6-ea35-4771-914a-5d72b43f3cb3" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-fbab2ec6-ea35-4771-914a-5d72b43f3cb3" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8dc20-ec34-49b1-a0e5-0dd8b9b2c834]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:31 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 Sep 11 14:06:31 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:31 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3" returned: 0 in 0.353s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:31 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3 Sep 11 14:06:31 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:32 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fbab2ec6-ea35-4771-914a-5d72b43f3cb3" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-fbab2ec6-ea35-4771-914a-5d72b43f3cb3" released by "delete_volume" :: held 0.629s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created reservations ['81631231-a903-4948-bad4-b6febf1837c2', '14e5fb15-f754-4dcc-9e54-0d0ffbb6bcb9', '34e40291-331d-4dd3-aeb7-bf6e25e0b382', 'd73f9ee9-2b58-4ce5-b1cf-68f35682b551'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:32 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:32 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:32 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.238s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Deleted volume successfully. Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e92b1a33-971e-4ba0-a30f-4b43a23f2356 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-fbab2ec6-ea35-4771-914a-5d72b43f3cb3-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-a9ab9193-6d25-495e-bbea-b8cff9e225fa-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-a9ab9193-6d25-495e-bbea-b8cff9e225fa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-quobyte-a9ab9193-6d25-495e-bbea-b8cff9e225fa" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-a9ab9193-6d25-495e-bbea-b8cff9e225fa" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff198720-0946-4c71-a9f4-0d98d9069ca4]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:32 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa Sep 11 14:06:32 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:33 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa" returned: 0 in 0.350s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:33 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa Sep 11 14:06:33 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:33 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a9ab9193-6d25-495e-bbea-b8cff9e225fa" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-a9ab9193-6d25-495e-bbea-b8cff9e225fa" released by "delete_volume" :: held 0.629s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created reservations ['4d1f9f93-a6c6-4606-b40a-fd9d1ce9c1b2', 'bb35e88e-79bd-4e56-9997-6aad9a3318db', 'b2314479-bd9b-4540-b9eb-8dee3f562580', 'cc626ef8-cd16-484e-8b8f-11d0385c2378'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:33 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:33 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:33 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Deleted volume successfully. Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6141a122-3c4d-4392-8bfd-50f4a49f3856 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-a9ab9193-6d25-495e-bbea-b8cff9e225fa-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-5fbe02dc-41eb-40a8-a201-6837311fb04b-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-5fbe02dc-41eb-40a8-a201-6837311fb04b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-quobyte-5fbe02dc-41eb-40a8-a201-6837311fb04b" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-5fbe02dc-41eb-40a8-a201-6837311fb04b" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8912dbb-41bc-4fee-ba46-b07729ad6111]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:33 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b Sep 11 14:06:33 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:34 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:34 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b Sep 11 14:06:34 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:34 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5fbe02dc-41eb-40a8-a201-6837311fb04b" returned: 0 in 0.239s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-5fbe02dc-41eb-40a8-a201-6837311fb04b" released by "delete_volume" :: held 0.629s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created reservations ['acb15ea6-603b-4379-ae68-412f6792b945', '290edc95-2a9d-4d8a-b1b2-597165f8ad17', '318566c3-aaa7-462a-bb94-b2cedb3f2e81', 'f2136952-fcbb-4c25-9cfa-8485b58ea861'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:34 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:34 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Deleted volume successfully. Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aa63369f-cf7f-44fb-894a-33b76e015333 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-5fbe02dc-41eb-40a8-a201-6837311fb04b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-55eb9f0e-d4cb-428c-9071-650bb825a1e1-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-55eb9f0e-d4cb-428c-9071-650bb825a1e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-quobyte-55eb9f0e-d4cb-428c-9071-650bb825a1e1" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-55eb9f0e-d4cb-428c-9071-650bb825a1e1" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[770a631e-df88-4ebc-bba3-b11436a0c326]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:35 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 Sep 11 14:06:35 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:35 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1" returned: 0 in 0.360s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:35 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1 Sep 11 14:06:35 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:35 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-55eb9f0e-d4cb-428c-9071-650bb825a1e1" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-55eb9f0e-d4cb-428c-9071-650bb825a1e1" released by "delete_volume" :: held 0.639s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created reservations ['ddc81570-8f96-48d2-8740-541cd7dd2d10', '1b201fc8-9618-472e-8797-8b488b471bce', 'dd35925f-4b4d-4b46-89f5-e8b3e3e9ba5f', '5f413be0-b301-4ecd-83d8-141f0518463c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:35 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:35 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:35 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:35 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Deleted volume successfully. Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-106aa216-98ca-4b03-893a-d8fb9d0fc396 tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-55eb9f0e-d4cb-428c-9071-650bb825a1e1-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-f8cfb6bf-9052-4f77-9841-20952d4c0f34-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-f8cfb6bf-9052-4f77-9841-20952d4c0f34-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "cinder-quobyte-f8cfb6bf-9052-4f77-9841-20952d4c0f34" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-f8cfb6bf-9052-4f77-9841-20952d4c0f34" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b6f9a-2eb6-4712-bd22-cd9fddac95b4]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:36 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 Sep 11 14:06:36 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:36 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34" returned: 0 in 0.353s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:36 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34 Sep 11 14:06:36 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:36 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f8cfb6bf-9052-4f77-9841-20952d4c0f34" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-quobyte-f8cfb6bf-9052-4f77-9841-20952d4c0f34" released by "delete_volume" :: held 0.634s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Created reservations ['462ae981-cb33-4f36-91a5-2edaed6de7d1', '91984241-4e19-41bc-acfa-96b17c07fafc', '7a98253d-d885-4302-b5db-82d0ab53dcc0', '5f36bd02-2b96-48b2-bed3-4100639c87a2'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:36 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:36 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:37 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.239s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:37 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:37 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Deleted volume successfully. Sep 11 14:06:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-3cec84b3-15a4-49f5-b2c3-dca613a3c02d tempest-CreateVolumesFromSourceVolumeTest-1691245946 None] Lock "cinder-f8cfb6bf-9052-4f77-9841-20952d4c0f34-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Flow 'volume_create_manager' (0c630bbe-34b7-4b5a-9f3a-40025f58e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9ccb4a-ab4e-40aa-926e-682bc6dc1b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9ccb4a-ab4e-40aa-926e-682bc6dc1b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-699103963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeef3ac-b216-4526-93ec-a9fa8b1c84e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb56099d03264606a27c1a265341a7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:40Z,use_quota=True,user_id='42ce342b37b94b288cee8a146ba8bfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434f763d-ac2e-4b57-bac0-6c308c883204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434f763d-ac2e-4b57-bac0-6c308c883204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0a5191-c08a-4daf-b3c6-6da63b26416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0a5191-c08a-4daf-b3c6-6da63b26416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeef3ac-b216-4526-93ec-a9fa8b1c84e0', 'volume_name': 'volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93912356-d8cf-4669-8d4d-3c2f22d2e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93912356-d8cf-4669-8d4d-3c2f22d2e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339cc074-506e-473a-8b9d-1682b15167be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:39 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Volume 2eeef3ac-b216-4526-93ec-a9fa8b1c84e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0', 'volume_size': 1} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-699103963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeef3ac-b216-4526-93ec-a9fa8b1c84e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb56099d03264606a27c1a265341a7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:40Z,use_quota=True,user_id='42ce342b37b94b288cee8a146ba8bfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Creating volume 2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:39 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:06:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:39 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 1073741824 Sep 11 14:06:39 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:40 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 1073741824" returned: 0 in 0.426s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:40 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 Sep 11 14:06:40 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:40 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339cc074-506e-473a-8b9d-1682b15167be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17681e0f-6356-4792-971a-9cef99b77e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:40 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Volume volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 (2eeef3ac-b216-4526-93ec-a9fa8b1c84e0): created successfully Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17681e0f-6356-4792-971a-9cef99b77e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Flow 'volume_create_manager' (0c630bbe-34b7-4b5a-9f3a-40025f58e667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-dad220f1-57ed-4414-8b26-45b9bc417e17 tempest-VolumeDependencyTests-1214631534 None] Created volume successfully. Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Creating offline snapshot e99d45bb-6047-4707-aee2-f680508238dd of volume 2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7afc5cc-7698-44ed-b6eb-16ede37dc8c7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:41 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 Sep 11 14:06:41 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:41 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" returned: 0 in 0.357s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:41 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd 1G Sep 11 14:06:41 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:41 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd 1G" returned: 0 in 0.377s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:41 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd Sep 11 14:06:41 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:42 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:42 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd is being set with open permissions: ugo+rw Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:42 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd Sep 11 14:06:42 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:42 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd" returned: 0 in 0.240s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:42 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info Sep 11 14:06:42 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:42 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:42 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info is being set with open permissions: ugo+rw Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:42 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info Sep 11 14:06:42 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:42 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.info" returned: 0 in 0.239s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5b9b4991-9cfb-49f2-89e9-191a2298f5e4 tempest-VolumeDependencyTests-1214631534 None] Create snapshot completed successfully Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Flow 'volume_create_manager' (a8040da2-af2e-4eac-ae1a-83a46efa670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a184d303-26ec-4d25-8dae-c6d11e53ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a184d303-26ec-4d25-8dae-c6d11e53ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502898351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb56099d03264606a27c1a265341a7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e99d45bb-6047-4707-aee2-f680508238dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:06:44Z,use_quota=True,user_id='42ce342b37b94b288cee8a146ba8bfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66547006-9461-478c-8873-6a1ef2cb45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66547006-9461-478c-8873-6a1ef2cb45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb6f076-d9e1-4bd0-8af6-3ce2aaf30649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb6f076-d9e1-4bd0-8af6-3ce2aaf30649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1', 'volume_name': 'volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1', 'volume_size': 1, 'snapshot_id': 'e99d45bb-6047-4707-aee2-f680508238dd'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c06126-8139-401b-b9eb-1e6762066ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c06126-8139-401b-b9eb-1e6762066ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63efea1a-980d-4f0f-9aa8-5266fec133b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:43 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Volume 7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1', 'volume_size': 1, 'snapshot_id': 'e99d45bb-6047-4707-aee2-f680508238dd'} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-quobyte-e99d45bb-6047-4707-aee2-f680508238dd-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-e99d45bb-6047-4707-aee2-f680508238dd-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Creating volume 7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 from snapshot e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-quobyte-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] snapshot: e99d45bb-6047-4707-aee2-f680508238dd, volume: 7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f9b09f-77f6-44fc-b33e-531ea294158a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:43 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd Sep 11 14:06:43 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:44 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd" returned: 0 in 0.363s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d6c51-dcc4-4c4c-918b-1de645c2688b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:44 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 Sep 11 14:06:44 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:44 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 14:06:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:44 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 Sep 11 14:06:44 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:48 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" returned: 0 in 4.092s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:06:48 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Converted 1024.00 MB image at 250.16 MB/s Sep 11 14:06:48 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 is being set with open permissions: ugo+rw Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:48 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 Sep 11 14:06:48 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:48 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" returned: 0 in 0.236s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" released by "_copy_volume_from_snapshot" :: held 5.115s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-e99d45bb-6047-4707-aee2-f680508238dd-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" released by "_create_volume_from_snapshot" :: held 5.171s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.186s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63efea1a-980d-4f0f-9aa8-5266fec133b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1', 'volume_size': 1, 'snapshot_id': 'e99d45bb-6047-4707-aee2-f680508238dd'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c489fee-9e25-4533-a0ff-8176bc3d5144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:06:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Volume volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 (7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1): created successfully Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c489fee-9e25-4533-a0ff-8176bc3d5144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:06:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Flow 'volume_create_manager' (a8040da2-af2e-4eac-ae1a-83a46efa670e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:06:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8aad09bf-1ac7-40a1-ac44-e4dc68ff8e6e tempest-VolumeDependencyTests-1214631534 None] Created volume successfully. Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-e99d45bb-6047-4707-aee2-f680508238dd-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-e99d45bb-6047-4707-aee2-f680508238dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-quobyte-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-quobyte-e99d45bb-6047-4707-aee2-f680508238dd" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-e99d45bb-6047-4707-aee2-f680508238dd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Deleting offline snapshot e99d45bb-6047-4707-aee2-f680508238dd of volume 2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] snapshot_file for this snap is: volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e90b07-5d37-4f19-b131-848f8bd33933]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:49 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd Sep 11 14:06:49 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:49 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71fbcc-c2a6-42f5-959e-882a40401591]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:49 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 Sep 11 14:06:49 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:50 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" returned: 0 in 0.523s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:50 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd Sep 11 14:06:50 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:50 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd" returned: 0 in 0.327s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:50 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd Sep 11 14:06:50 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:50 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0.e99d45bb-6047-4707-aee2-f680508238dd" returned: 0 in 0.241s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-e99d45bb-6047-4707-aee2-f680508238dd" released by "_delete_snapshot" :: held 1.540s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" released by "delete_snapshot" :: held 1.564s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Created reservations ['818126d4-38c1-4393-92d2-a46a8a150563', 'cc04f3c6-ef28-460f-b97e-40c9387f0dec', 'f6f73821-194b-4630-91f0-3404d416158f', '943b13df-c4e4-4811-888a-38efe9a61962'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Delete snapshot completed successfully. Sep 11 14:06:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-57c304fc-a5c6-40ae-97a8-25efa98d700e tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-e99d45bb-6047-4707-aee2-f680508238dd-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-quobyte-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" acquired by "delete_volume" :: waited 0.013s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b436f61-480f-4788-9941-c95cd64c09ea]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:51 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 Sep 11 14:06:51 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:51 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:51 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0 Sep 11 14:06:51 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:51 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" returned: 0 in 0.234s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0" released by "delete_volume" :: held 0.633s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:51 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Created reservations ['5da6f3b1-088a-4c3f-9dda-d1ef3b39ada2', '26ca55e0-3a8d-4c3d-9eee-63d670d0e3b9', 'e61e21a2-41a5-46be-b66c-334290c6e565', 'e5543b8d-cab2-480f-9c64-f627b2d2f637'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:52 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:52 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:52 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.239s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:52 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Deleted volume successfully. Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-874dc6cd-1749-4113-bb5c-66c11eab8c20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-2eeef3ac-b216-4526-93ec-a9fa8b1c84e0-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "cinder-quobyte-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0501e37c-6448-4b22-a9bc-3a1dcf8f28f0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:52 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 Sep 11 14:06:52 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:52 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:52 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1 Sep 11 14:06:52 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:53 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" returned: 0 in 0.236s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-quobyte-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1" released by "delete_volume" :: held 0.614s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Created reservations ['a0185b0d-abe3-48ee-858c-f19fd564ff3a', '777618ce-f3b7-40c3-9a9c-669f2ae7af43', 'c08720c5-f935-42c5-880f-81ebcc6efeb7', '98418336-23e9-4e41-9c14-9191afe7c502'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:06:53 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:06:53 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:06:53 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.237s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:06:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Deleted volume successfully. Sep 11 14:06:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-92b543f9-33e5-4f8f-8e68-051713183f20 tempest-VolumeDependencyTests-1214631534 None] Lock "cinder-7e3a9f7d-b8b4-42ee-a1d8-b655bfce55c1-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:03 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:INSERT=32,cinder:UPDATE=128,cinder:SELECT=86,cinder:DELETE=16 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:07:03 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=88,cinder:INSERT=30,cinder:UPDATE=126,cinder:DELETE=5 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (77bac709-b3c7-4cfe-bb24-c2d2cea68ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14389d19-2895-4b1f-9d99-ce8c1c35fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14389d19-2895-4b1f-9d99-ce8c1c35fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-988840296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5095f615-ef11-4131-88e6-2fff2f782d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:05Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1668f36-324d-4b87-8751-e7573f634825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1668f36-324d-4b87-8751-e7573f634825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b944f3-4320-4e5a-b282-7cce7b7cd1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b944f3-4320-4e5a-b282-7cce7b7cd1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5095f615-ef11-4131-88e6-2fff2f782d61', 'volume_name': 'volume-5095f615-ef11-4131-88e6-2fff2f782d61', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e87d2ba-1162-4111-bfbe-e47a089babbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e87d2ba-1162-4111-bfbe-e47a089babbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614f326f-8b9b-4298-87ab-4401df896783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Volume 5095f615-ef11-4131-88e6-2fff2f782d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5095f615-ef11-4131-88e6-2fff2f782d61', 'volume_size': 1} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-988840296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5095f615-ef11-4131-88e6-2fff2f782d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:05Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Creating volume 5095f615-ef11-4131-88e6-2fff2f782d61 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:05 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 1073741824 Sep 11 14:07:05 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Flow 'volume_create_manager' (8e23a50d-0504-4dc7-83f4-477cf116b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43eee254-6ba2-4ae7-b625-9557dfa6a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43eee254-6ba2-4ae7-b625-9557dfa6a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1819328705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9562e01-7e91-4e5d-b4c3-faf3cda78901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3cf349835c4b9e8ad060df4a8482d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:06Z,use_quota=True,user_id='019f7920a0fd42308ab13ed81198ea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4a8544-8af4-48fb-aa23-1ed844171456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4a8544-8af4-48fb-aa23-1ed844171456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56625444-05d1-4633-b124-fe8e3da6d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56625444-05d1-4633-b124-fe8e3da6d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9562e01-7e91-4e5d-b4c3-faf3cda78901', 'volume_name': 'volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4f5799-6eab-446e-bbaf-e654fa34766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4f5799-6eab-446e-bbaf-e654fa34766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffca8251-3759-44ab-a115-5cef8b558ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Volume b9562e01-7e91-4e5d-b4c3-faf3cda78901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901', 'volume_size': 1} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (47a709c7-7da5-49a7-8697-7af7a40dfff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4356063a-67ff-44b4-b70c-240febd4d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4356063a-67ff-44b4-b70c-240febd4d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530845309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df60015-0868-4469-9635-7b58d57ea0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:06Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef9e195-f051-4141-8be3-d78dab592f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef9e195-f051-4141-8be3-d78dab592f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f337c9-ecc5-4e28-b7b3-6845d060a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f337c9-ecc5-4e28-b7b3-6845d060a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df60015-0868-4469-9635-7b58d57ea0c2', 'volume_name': 'volume-6df60015-0868-4469-9635-7b58d57ea0c2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98be2951-4a56-44bf-8eca-de8de22734b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98be2951-4a56-44bf-8eca-de8de22734b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee70b71-5bbb-4b99-8342-6fb60cc31f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Volume 6df60015-0868-4469-9635-7b58d57ea0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df60015-0868-4469-9635-7b58d57ea0c2', 'volume_size': 1} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:06 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (04228117-57cf-484e-a355-ec29dbc13c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d1febc-14dd-40d6-ac60-e26955d84287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 1073741824" returned: 0 in 0.933s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d1febc-14dd-40d6-ac60-e26955d84287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-378226597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3eda5-b357-447b-9977-a7ec62c9007b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:06Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa9c11b-a363-46c0-869e-96a34f1594a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa9c11b-a363-46c0-869e-96a34f1594a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b845926-a1ee-41f2-b24b-b338cb0a928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b845926-a1ee-41f2-b24b-b338cb0a928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b3eda5-b357-447b-9977-a7ec62c9007b', 'volume_name': 'volume-f6b3eda5-b357-447b-9977-a7ec62c9007b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7a561e-6f77-485d-b17f-5843aaf7ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7a561e-6f77-485d-b17f-5843aaf7ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc4ba28-fe53-453e-bb9e-ccebda736c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Volume f6b3eda5-b357-447b-9977-a7ec62c9007b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b3eda5-b357-447b-9977-a7ec62c9007b', 'volume_size': 1} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:06 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 Sep 11 14:07:06 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:06 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61" returned: 0 in 0.334s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1819328705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9562e01-7e91-4e5d-b4c3-faf3cda78901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3cf349835c4b9e8ad060df4a8482d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:06Z,use_quota=True,user_id='019f7920a0fd42308ab13ed81198ea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Creating volume b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:06 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:06 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 1073741824 Sep 11 14:07:06 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (2cffbf99-dd15-4d75-a425-04ecf51c6108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133c32c3-9798-465f-a662-3270cb4debae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614f326f-8b9b-4298-87ab-4401df896783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5095f615-ef11-4131-88e6-2fff2f782d61', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b078483-0755-46e7-94d4-907cf888b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133c32c3-9798-465f-a662-3270cb4debae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780140124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd3c0ae-fc52-41dc-9f86-122949c671a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:07Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dab56fc-3439-4b10-a39c-3d2bed3aae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dab56fc-3439-4b10-a39c-3d2bed3aae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680202e5-d103-4efa-84cf-f279f4650621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680202e5-d103-4efa-84cf-f279f4650621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd3c0ae-fc52-41dc-9f86-122949c671a3', 'volume_name': 'volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67938115-d39a-4f2b-bfe3-eb80bd0834cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67938115-d39a-4f2b-bfe3-eb80bd0834cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8367dec-90ac-4ef5-8d72-3a4543b099dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Volume 9bd3c0ae-fc52-41dc-9f86-122949c671a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3', 'volume_size': 1} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Volume volume-5095f615-ef11-4131-88e6-2fff2f782d61 (5095f615-ef11-4131-88e6-2fff2f782d61): created successfully Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b078483-0755-46e7-94d4-907cf888b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (77bac709-b3c7-4cfe-bb24-c2d2cea68ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:06 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9017034f-c705-4ae0-83eb-8a033306817e tempest-CreateVolumesFromImageTest-985489990 None] Created volume successfully. Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (da5bda0b-1d96-4136-a85b-9728b5565b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636aecce-567b-47db-86a1-d6be1ba37c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636aecce-567b-47db-86a1-d6be1ba37c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760731196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85022c6d-ab8b-48ec-8174-715335871994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:07Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4520bdb-217a-43d1-967f-8d8957a23f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4520bdb-217a-43d1-967f-8d8957a23f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87993577-c561-4dbe-87df-17d5d31046c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87993577-c561-4dbe-87df-17d5d31046c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85022c6d-ab8b-48ec-8174-715335871994', 'volume_name': 'volume-85022c6d-ab8b-48ec-8174-715335871994', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73949af5-d97f-494b-a3e9-7d7e7559ca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73949af5-d97f-494b-a3e9-7d7e7559ca87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0837f5-434d-494b-bd4f-6b564fbc1225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Volume 85022c6d-ab8b-48ec-8174-715335871994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85022c6d-ab8b-48ec-8174-715335871994', 'volume_size': 1} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:07 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 1073741824" returned: 0 in 0.677s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:07 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 Sep 11 14:07:07 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:07 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530845309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df60015-0868-4469-9635-7b58d57ea0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:06Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Creating volume 6df60015-0868-4469-9635-7b58d57ea0c2 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:07 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffca8251-3759-44ab-a115-5cef8b558ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:07 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 1073741824 Sep 11 14:07:07 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1b2a54-4840-43ad-9b23-65b9cf5ae687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Volume volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 (b9562e01-7e91-4e5d-b4c3-faf3cda78901): created successfully Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1b2a54-4840-43ad-9b23-65b9cf5ae687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Flow 'volume_create_manager' (8e23a50d-0504-4dc7-83f4-477cf116b032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7bee7370-c85d-4236-8b82-ed4f6f33165c tempest-VolumeDependencyTests-1432579454 None] Created volume successfully. Sep 11 14:07:08 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 1073741824" returned: 0 in 0.512s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:08 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 Sep 11 14:07:08 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:08 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-378226597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3eda5-b357-447b-9977-a7ec62c9007b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:06Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Creating volume f6b3eda5-b357-447b-9977-a7ec62c9007b {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:08 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee70b71-5bbb-4b99-8342-6fb60cc31f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df60015-0868-4469-9635-7b58d57ea0c2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:08 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b 1073741824 Sep 11 14:07:08 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e364c5df-100b-4b26-afe7-c3be02005b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:08 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Volume volume-6df60015-0868-4469-9635-7b58d57ea0c2 (6df60015-0868-4469-9635-7b58d57ea0c2): created successfully Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e364c5df-100b-4b26-afe7-c3be02005b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (47a709c7-7da5-49a7-8697-7af7a40dfff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:08 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-eb638c24-e9e2-4653-a8a0-51e1242e7b07 tempest-CreateVolumesFromImageTest-985489990 None] Created volume successfully. Sep 11 14:07:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:09 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b 1073741824" returned: 0 in 0.565s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:09 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b Sep 11 14:07:09 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:09 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.602s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780140124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd3c0ae-fc52-41dc-9f86-122949c671a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:07Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Creating volume 9bd3c0ae-fc52-41dc-9f86-122949c671a3 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:09 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc4ba28-fe53-453e-bb9e-ccebda736c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b3eda5-b357-447b-9977-a7ec62c9007b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:09 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 1073741824 Sep 11 14:07:09 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e797083-6490-457c-8d92-8c130809f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:09 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Volume volume-f6b3eda5-b357-447b-9977-a7ec62c9007b (f6b3eda5-b357-447b-9977-a7ec62c9007b): created successfully Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e797083-6490-457c-8d92-8c130809f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (04228117-57cf-484e-a355-ec29dbc13c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-435c1673-db91-4a69-8135-a299d6d78897 tempest-CreateVolumesFromImageTest-985489990 None] Created volume successfully. Sep 11 14:07:09 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 1073741824" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:09 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 Sep 11 14:07:09 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:10 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3" returned: 0 in 0.334s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760731196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85022c6d-ab8b-48ec-8174-715335871994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c053e3fc554175a531cc33ff1ff876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:07Z,use_quota=True,user_id='7750f3af0d0b4f7d928f490532dc8a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Creating volume 85022c6d-ab8b-48ec-8174-715335871994 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:10 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:10 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 1073741824 Sep 11 14:07:10 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8367dec-90ac-4ef5-8d72-3a4543b099dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad789959-0e2f-444e-860d-eca47aed05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Flow 'volume_create_manager' (0ea78c35-b3cb-4c33-aeac-cb3afc413295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e68e84-ba3c-460c-a4d3-6ff76dd192ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Volume volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 (9bd3c0ae-fc52-41dc-9f86-122949c671a3): created successfully Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad789959-0e2f-444e-860d-eca47aed05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (2cffbf99-dd15-4d75-a425-04ecf51c6108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e68e84-ba3c-460c-a4d3-6ff76dd192ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f90ce9-0bb5-419c-b064-74072d41118b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eff61337197435c99866860563fdc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:10Z,use_quota=True,user_id='f580e48c9a494d09b81477cf1462e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e11c557-11cc-4ba7-a94a-e76b3e503cbc),volume_type_id=0e11c557-11cc-4ba7-a94a-e76b3e503cbc)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740ae5d0-4271-43c4-8ed8-bf53fc6233e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740ae5d0-4271-43c4-8ed8-bf53fc6233e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92e9483-4080-4898-a987-3c87eec05cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 14:07:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-efc1b651-8018-4523-8bb3-5611cebb21b5 tempest-CreateVolumesFromImageTest-985489990 None] Created volume successfully. Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:10 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:10 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:10 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 1073741824" returned: 0 in 0.538s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:10 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 Sep 11 14:07:10 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:10 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.318s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92e9483-4080-4898-a987-3c87eec05cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60f90ce9-0bb5-419c-b064-74072d41118b', 'volume_name': 'volume-60f90ce9-0bb5-419c-b064-74072d41118b', 'volume_size': 1, 'image_id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '552d27f3fdeb73798b0ee6ec9d43d830', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eff61337197435c99866860563fdc18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff11faf23fb1da085939a82790a20c982d94a0ae9a3f4e7ac746cda3ef08ba181397b6d7aceaf0b31e82938f2b0419abb05f53e70d213a226750108ad1098a1a', 'id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'created_at': datetime.datetime(2026, 9, 11, 12, 7, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eae1617-f7b4-4455-a787-b06a489a64fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eae1617-f7b4-4455-a787-b06a489a64fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0715dd-601c-460f-8a06-0245f7246dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Volume 60f90ce9-0bb5-419c-b064-74072d41118b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60f90ce9-0bb5-419c-b064-74072d41118b', 'volume_size': 1, 'image_id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '552d27f3fdeb73798b0ee6ec9d43d830', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eff61337197435c99866860563fdc18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff11faf23fb1da085939a82790a20c982d94a0ae9a3f4e7ac746cda3ef08ba181397b6d7aceaf0b31e82938f2b0419abb05f53e70d213a226750108ad1098a1a', 'id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'created_at': datetime.datetime(2026, 9, 11, 12, 7, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 14:07:10 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Trying to clone 60f90ce9-0bb5-419c-b064-74072d41118b from image 3f74b4dc-f74e-445c-9d69-2987e483ca5c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 14:07:11 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Image download 0.00 MB at 0.00 MB/s Sep 11 14:07:11 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[453fae32-1fa7-4138-815e-9a062e54bec8]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.138s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0837f5-434d-494b-bd4f-6b564fbc1225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85022c6d-ab8b-48ec-8174-715335871994', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3de6c63-4de9-4e90-b3a2-0586565987e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Creating offline snapshot 5b8076bd-5280-4059-81b1-9afe4edc9183 of volume b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:07:11 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Volume volume-85022c6d-ab8b-48ec-8174-715335871994 (85022c6d-ab8b-48ec-8174-715335871994): created successfully Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3de6c63-4de9-4e90-b3a2-0586565987e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Flow 'volume_create_manager' (da5bda0b-1d96-4136-a85b-9728b5565b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73d798-bd31-4a3e-ab3b-038dc5730a05]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:11 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a011b539-f0af-4f55-80b7-1a92ab08343c tempest-CreateVolumesFromImageTest-985489990 None] Created volume successfully. Sep 11 14:07:11 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD Sep 11 14:07:11 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:11 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 Sep 11 14:07:11 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:11 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:11 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD Sep 11 14:07:11 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:11 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901" returned: 0 in 0.438s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:11 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 1G Sep 11 14:07:11 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-85022c6d-ab8b-48ec-8174-715335871994-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-85022c6d-ab8b-48ec-8174-715335871994-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-quobyte-85022c6d-ab8b-48ec-8174-715335871994" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-85022c6d-ab8b-48ec-8174-715335871994" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d1f95f-ef39-409d-9155-f6a36378aee9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:11 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:07:11 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Temporary image 3f74b4dc-f74e-445c-9d69-2987e483ca5c is fetched for user f580e48c9a494d09b81477cf1462e9b7. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 14:07:11 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 Sep 11 14:07:11 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f17d3-b223-455e-abb6-0a5d4448f5fc]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD Sep 11 14:07:12 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 1G" returned: 0 in 0.568s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 Sep 11 14:07:12 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994" returned: 0 in 0.462s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994 Sep 11 14:07:12 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD Sep 11 14:07:12 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183" returned: 0 in 0.315s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 is being set with open permissions: ugo+rw Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 Sep 11 14:07:12 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-85022c6d-ab8b-48ec-8174-715335871994" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-85022c6d-ab8b-48ec-8174-715335871994" released by "delete_volume" :: held 0.768s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Created reservations ['d00985be-9dea-4883-be69-56a1739d6f73', '523c98fb-3201-452f-ba69-c00cf9540a78', '00aac911-5de9-40b2-9b7d-9b2d5707359c', '023e75c0-a6d0-48d8-bc16-2cbc40154a0d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:12 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:12 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:12 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info Sep 11 14:07:12 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-9bd3c0ae-fc52-41dc-9f86-122949c671a3-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-9bd3c0ae-fc52-41dc-9f86-122949c671a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:12 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:12 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Deleted volume successfully. Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-quobyte-9bd3c0ae-fc52-41dc-9f86-122949c671a3" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ecf32737-3cc1-4c98-8ce0-b8c5e7490e9c tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-85022c6d-ab8b-48ec-8174-715335871994-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-9bd3c0ae-fc52-41dc-9f86-122949c671a3" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb045dd-8ddb-4a47-afdc-53fe560bbd14]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:13 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info" returned: 0 in 0.326s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:13 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info is being set with open permissions: ugo+rw Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:13 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info Sep 11 14:07:13 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:13 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 Sep 11 14:07:13 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:13 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.info" returned: 0 in 0.268s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f90ce9-0bb5-419c-b064-74072d41118b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eff61337197435c99866860563fdc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:10Z,use_quota=True,user_id='f580e48c9a494d09b81477cf1462e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e11c557-11cc-4ba7-a94a-e76b3e503cbc),volume_type_id=0e11c557-11cc-4ba7-a94a-e76b3e503cbc)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Creating volume 60f90ce9-0bb5-419c-b064-74072d41118b {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:13 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:13 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b 1073741824 Sep 11 14:07:13 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-60eeeee9-3bfa-4ec3-91df-a5d4fecddcdd tempest-VolumeDependencyTests-1432579454 None] Create snapshot completed successfully Sep 11 14:07:13 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3" returned: 0 in 0.437s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:13 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3 Sep 11 14:07:13 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:13 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-9bd3c0ae-fc52-41dc-9f86-122949c671a3" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-9bd3c0ae-fc52-41dc-9f86-122949c671a3" released by "delete_volume" :: held 0.751s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Created reservations ['34056af0-a1b2-4be7-a965-78dbf1c94163', 'ad8fd28b-dc99-405a-82d3-411936eef1c0', '0196c972-5b47-47c8-bb5e-8109a6981c5f', 'b162023c-6f75-47aa-86c7-e2273426a589'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:13 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b 1073741824" returned: 0 in 0.513s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:13 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:13 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:14 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b Sep 11 14:07:14 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:14 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.299s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Deleted volume successfully. Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8b0fd690-bbc2-458e-9fcf-e10366f34f52 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-9bd3c0ae-fc52-41dc-9f86-122949c671a3-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:14 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Attempting download of 3f74b4dc-f74e-445c-9d69-2987e483ca5c ((None, [{'url': 'file:///opt/stack/data/glance/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'metadata': {}}])) to volume 60f90ce9-0bb5-419c-b064-74072d41118b. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22405680-e5d7-4d73-85c5-0434cbc80ce9]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-f6b3eda5-b357-447b-9977-a7ec62c9007b-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-f6b3eda5-b357-447b-9977-a7ec62c9007b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-quobyte-f6b3eda5-b357-447b-9977-a7ec62c9007b" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-f6b3eda5-b357-447b-9977-a7ec62c9007b" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dccc81c-6142-4d5d-9689-443424031976]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:14 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c Sep 11 14:07:14 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:14 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b Sep 11 14:07:14 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:14 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Flow 'volume_create_manager' (b851b710-1376-40a9-944e-0536239e100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d1983-4094-4e74-869d-a10d9064a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c" returned: 0 in 0.462s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d1983-4094-4e74-869d-a10d9064a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-141835428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3cf349835c4b9e8ad060df4a8482d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b8076bd-5280-4059-81b1-9afe4edc9183,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:15Z,use_quota=True,user_id='019f7920a0fd42308ab13ed81198ea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78d243f-313e-4c7d-9c6f-610cd50f9202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78d243f-313e-4c7d-9c6f-610cd50f9202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c5015e-6d33-4d1f-afb9-d7049f0d3066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c5015e-6d33-4d1f-afb9-d7049f0d3066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce', 'volume_name': 'volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce', 'volume_size': 1, 'snapshot_id': '5b8076bd-5280-4059-81b1-9afe4edc9183'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:14 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed6881e-aa63-4072-8162-3757e9a11dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed6881e-aa63-4072-8162-3757e9a11dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713b175c-6f8d-42fa-b74b-15ecbe4aaa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Volume 0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce', 'volume_size': 1, 'snapshot_id': '5b8076bd-5280-4059-81b1-9afe4edc9183'} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b" returned: 0 in 0.409s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-quobyte-5b8076bd-5280-4059-81b1-9afe4edc9183-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:14 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b Sep 11 14:07:14 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-5b8076bd-5280-4059-81b1-9afe4edc9183-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Creating volume 0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce from snapshot 5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:14 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-quobyte-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:14 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] snapshot: 5b8076bd-5280-4059-81b1-9afe4edc9183, volume: 0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8855356-1f50-4893-a212-e8c872dfd6de]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:15 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-f6b3eda5-b357-447b-9977-a7ec62c9007b" returned: 0 in 0.296s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:15 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-f6b3eda5-b357-447b-9977-a7ec62c9007b" released by "delete_volume" :: held 0.749s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c" returned: 1 in 0.389s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f74b4dc-f74e-445c-9d69-2987e483ca5c_bti0590c' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7131082d-6b6d-4ea4-8988-fa3fb16ce3bf]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:15 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 Sep 11 14:07:15 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Created reservations ['914ceff2-da84-4637-8e4c-5eeec297e709', '835ac3c8-959c-4935-8cb8-e5529f597420', 'b10ce082-0db0-46ef-a855-64fe01504143', 'a9ba4a67-e0f4-4ad6-9d07-8e91251545fc'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:15 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD Sep 11 14:07:15 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:15 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:15 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-6df60015-0868-4469-9635-7b58d57ea0c2-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:15 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183" returned: 0 in 0.503s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-6df60015-0868-4469-9635-7b58d57ea0c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1f868f-5be2-4483-a26d-eb5cb08e04b8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-quobyte-6df60015-0868-4469-9635-7b58d57ea0c2" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-6df60015-0868-4469-9635-7b58d57ea0c2" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:15 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:15 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3e304b-fca7-45e1-b701-b986ba98f36e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:15 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.403s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:15 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Deleted volume successfully. Sep 11 14:07:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b401c197-65a5-4507-a5d8-f9d8203f69cf tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-f6b3eda5-b357-447b-9977-a7ec62c9007b-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:15 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD Sep 11 14:07:15 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:16 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 Sep 11 14:07:16 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:16 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901" returned: 0 in 0.518s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:16 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] 3f74b4dc-f74e-445c-9d69-2987e483ca5c was raw, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:16 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce Sep 11 14:07:16 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:16 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b Sep 11 14:07:16 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:16 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2" returned: 0 in 0.531s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:16 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2 Sep 11 14:07:16 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:16 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6df60015-0868-4469-9635-7b58d57ea0c2" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-6df60015-0868-4469-9635-7b58d57ea0c2" released by "delete_volume" :: held 0.853s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:16 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b" returned: 0 in 0.571s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f74b4dc-f74e-445c-9d69-2987e483ca5c_nok0gpdfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:07:16 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:16 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b 1G Sep 11 14:07:16 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Created reservations ['86460153-6aaf-42a1-a2b2-5cec0e254c92', '79ec508b-32a2-4367-9099-f822dcb99a91', 'b4771d64-363a-41df-a9a5-b3ee12b98c1e', 'e8d0dbea-9fe1-40d9-90e3-6df10e4e70a8'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:17 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:17 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:17 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b 1G" returned: 0 in 1.040s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Downloaded image 3f74b4dc-f74e-445c-9d69-2987e483ca5c ((None, [{'url': 'file:///opt/stack/data/glance/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'metadata': {}}])) to volume 60f90ce9-0bb5-419c-b064-74072d41118b successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Temporary image 3f74b4dc-f74e-445c-9d69-2987e483ca5c for user f580e48c9a494d09b81477cf1462e9b7 is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 14:07:17 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Marking volume 60f90ce9-0bb5-419c-b064-74072d41118b as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.734s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Deleted volume successfully. Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Copying metadata from image 3f74b4dc-f74e-445c-9d69-2987e483ca5c to 60f90ce9-0bb5-419c-b064-74072d41118b. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Creating volume glance metadata for volume 60f90ce9-0bb5-419c-b064-74072d41118b backed by image 3f74b4dc-f74e-445c-9d69-2987e483ca5c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '552d27f3fdeb73798b0ee6ec9d43d830', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 14:07:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-16f86964-27f3-4420-899a-52569b585791 tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-6df60015-0868-4469-9635-7b58d57ea0c2-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0715dd-601c-460f-8a06-0245f7246dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f90ce9-0bb5-419c-b064-74072d41118b', 'volume_size': 1, 'image_id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '552d27f3fdeb73798b0ee6ec9d43d830', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eff61337197435c99866860563fdc18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff11faf23fb1da085939a82790a20c982d94a0ae9a3f4e7ac746cda3ef08ba181397b6d7aceaf0b31e82938f2b0419abb05f53e70d213a226750108ad1098a1a', 'id': '3f74b4dc-f74e-445c-9d69-2987e483ca5c', 'created_at': datetime.datetime(2026, 9, 11, 12, 7, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f74b4dc-f74e-445c-9d69-2987e483ca5c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791362ea-cdaf-42ba-9e6b-52057dc7f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-5095f615-ef11-4131-88e6-2fff2f782d61-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:18 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Volume volume-60f90ce9-0bb5-419c-b064-74072d41118b (60f90ce9-0bb5-419c-b064-74072d41118b): created successfully Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791362ea-cdaf-42ba-9e6b-52057dc7f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Flow 'volume_create_manager' (0ea78c35-b3cb-4c33-aeac-cb3afc413295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-5095f615-ef11-4131-88e6-2fff2f782d61-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-31da43b6-c9a7-4caa-88a5-8048a2ba1fee tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Created volume successfully. Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "cinder-quobyte-5095f615-ef11-4131-88e6-2fff2f782d61" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-5095f615-ef11-4131-88e6-2fff2f782d61" acquired by "delete_volume" :: waited 0.041s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff00cc8a-5688-4fa7-be7a-8abf0255dae8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:18 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 Sep 11 14:07:18 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Acquiring lock "cinder-60f90ce9-0bb5-419c-b064-74072d41118b-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "cinder-60f90ce9-0bb5-419c-b064-74072d41118b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Acquiring lock "cinder-quobyte-60f90ce9-0bb5-419c-b064-74072d41118b" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "cinder-quobyte-60f90ce9-0bb5-419c-b064-74072d41118b" acquired by "delete_volume" :: waited 0.046s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d882acd-771f-43ff-8bc4-9e09e52098ee]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:19 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61" returned: 0 in 1.193s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:19 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61 Sep 11 14:07:19 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:19 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b Sep 11 14:07:19 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:20 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:20 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5095f615-ef11-4131-88e6-2fff2f782d61" returned: 0 in 0.965s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b" returned: 0 in 1.169s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:20 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-quobyte-5095f615-ef11-4131-88e6-2fff2f782d61" released by "delete_volume" :: held 2.310s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:20 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b Sep 11 14:07:20 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Created reservations ['8881756e-15eb-4b0b-ab00-c0fd6ad84c79', '5ded96fb-98a9-4a0e-aa8d-0d6393a60d9b', '884f4c95-883a-453e-8ea4-3ef2d79a86cf', '930fe722-3407-423b-b197-7ae250234af4'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:21 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-60f90ce9-0bb5-419c-b064-74072d41118b" returned: 0 in 0.571s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "cinder-quobyte-60f90ce9-0bb5-419c-b064-74072d41118b" released by "delete_volume" :: held 1.855s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:21 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:21 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Created reservations ['551663d2-d338-48db-82e2-7d0b38d8762a', 'a49388e2-ad30-434b-b96b-3591bf85423f', 'b120caf1-1800-4e8d-823d-04fb1b99fec0', '454f3268-a58e-47d6-9492-b0d205216b77'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:21 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:21 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:22 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.766s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Deleted volume successfully. Sep 11 14:07:22 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" returned: 0 in 5.903s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:07:22 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Converted 1024.00 MB image at 173.46 MB/s Sep 11 14:07:22 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce is being set with open permissions: ugo+rw Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f3a9299-c1b7-4110-b535-8cf1ceb686ae tempest-CreateVolumesFromImageTest-985489990 None] Lock "cinder-5095f615-ef11-4131-88e6-2fff2f782d61-delete_volume" released by "delete_volume" :: held 3.791s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:22 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce Sep 11 14:07:22 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:22 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.639s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Deleted volume successfully. Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0652eff4-2670-4f63-a970-f6e0a63b1b23 tempest-VolumeAndVolumeTypeFromImageTest-1763278081 None] Lock "cinder-60f90ce9-0bb5-419c-b064-74072d41118b-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:22 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" released by "_copy_volume_from_snapshot" :: held 7.468s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-5b8076bd-5280-4059-81b1-9afe4edc9183-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" released by "_create_volume_from_snapshot" :: held 7.573s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.592s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713b175c-6f8d-42fa-b74b-15ecbe4aaa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce', 'volume_size': 1, 'snapshot_id': '5b8076bd-5280-4059-81b1-9afe4edc9183'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06a58ad-db52-4b05-84b2-ace01b7bc94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:22 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Volume volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce (0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce): created successfully Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06a58ad-db52-4b05-84b2-ace01b7bc94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Flow 'volume_create_manager' (b851b710-1376-40a9-944e-0536239e100f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0e120fa3-6da6-4de5-8d77-22924e1b6e71 tempest-VolumeDependencyTests-1432579454 None] Created volume successfully. Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-5b8076bd-5280-4059-81b1-9afe4edc9183-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-5b8076bd-5280-4059-81b1-9afe4edc9183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-quobyte-b9562e01-7e91-4e5d-b4c3-faf3cda78901" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-b9562e01-7e91-4e5d-b4c3-faf3cda78901" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-quobyte-5b8076bd-5280-4059-81b1-9afe4edc9183" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-5b8076bd-5280-4059-81b1-9afe4edc9183" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Deleting offline snapshot 5b8076bd-5280-4059-81b1-9afe4edc9183 of volume b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] snapshot_file for this snap is: volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88beaef-f4c8-4326-b71b-34469a3c8af1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:22 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 Sep 11 14:07:22 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:23 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183" returned: 0 in 0.499s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:23 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:07:23 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddfb5a8-1e33-43f0-8ed7-e8b4deb1adc9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:23 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 Sep 11 14:07:23 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:24 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901" returned: 0 in 0.823s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:24 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 Sep 11 14:07:24 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:24 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183" returned: 0 in 0.456s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:24 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183 Sep 11 14:07:24 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:24 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901.5b8076bd-5280-4059-81b1-9afe4edc9183" returned: 0 in 0.322s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-5b8076bd-5280-4059-81b1-9afe4edc9183" released by "_delete_snapshot" :: held 2.231s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-b9562e01-7e91-4e5d-b4c3-faf3cda78901" released by "delete_snapshot" :: held 2.258s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:25 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Created reservations ['eac94c2c-f80b-4ac9-a0f0-0d52f9a880ed', '9c08d2a1-a418-4d0d-b5f1-7aba17795506', 'c16e051e-3bc1-4a2b-8c6c-449fec52fde0', '17f012bc-12cb-4605-b56b-ba6adc1b35fc'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Delete snapshot completed successfully. Sep 11 14:07:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b102bc05-767b-45ec-a45f-0a13ff80a2f4 tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-5b8076bd-5280-4059-81b1-9afe4edc9183-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-b9562e01-7e91-4e5d-b4c3-faf3cda78901-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-b9562e01-7e91-4e5d-b4c3-faf3cda78901-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-quobyte-b9562e01-7e91-4e5d-b4c3-faf3cda78901" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-b9562e01-7e91-4e5d-b4c3-faf3cda78901" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb847ff-20b1-4783-853e-7ec295bbdd20]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (7f10735b-2a15-42c9-86c3-dd21d051ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b7a7b4-72c7-4ba1-9b46-b3d7a7d08a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b7a7b4-72c7-4ba1-9b46-b3d7a7d08a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655313058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8d1fec-adbd-4899-b580-d72d7e7730f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:26Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0cd59b-cc03-4637-ac47-a5f48c8812da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0cd59b-cc03-4637-ac47-a5f48c8812da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d7bc59-2954-40ed-bef9-31f100b059e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d7bc59-2954-40ed-bef9-31f100b059e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8d1fec-adbd-4899-b580-d72d7e7730f8', 'volume_name': 'volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a807d6a-f56e-4bc9-bef4-2a257ac3f8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 Sep 11 14:07:26 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a807d6a-f56e-4bc9-bef4-2a257ac3f8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6b8172-63cd-4002-93af-d0f6bed36a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume bf8d1fec-adbd-4899-b580-d72d7e7730f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8', 'volume_size': 1} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655313058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8d1fec-adbd-4899-b580-d72d7e7730f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:26Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating volume bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:26 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:26 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 1073741824 Sep 11 14:07:26 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Flow 'volume_create_manager' (bca81c30-a26e-4e3d-80e7-41b169091f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e109d3-d648-41c0-929b-8b30da81a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e109d3-d648-41c0-929b-8b30da81a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534189620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1058e62b-c912-4edd-9826-03434f915c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b45d559ccb4d9d85136c94c3c87461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:26Z,use_quota=True,user_id='4c99588ff42243a087e78275be7cc0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3927a6-6f04-4062-81f2-5a5e3673166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3927a6-6f04-4062-81f2-5a5e3673166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21ee446-5ee6-40e4-b3e3-fa1289ed08b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21ee446-5ee6-40e4-b3e3-fa1289ed08b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1058e62b-c912-4edd-9826-03434f915c41', 'volume_name': 'volume-1058e62b-c912-4edd-9826-03434f915c41', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f895c477-da1a-40dc-88a7-0ca9bc6dfd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f895c477-da1a-40dc-88a7-0ca9bc6dfd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8e913b-5bb3-4ffe-b034-c13e17d1728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:26 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Volume 1058e62b-c912-4edd-9826-03434f915c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1058e62b-c912-4edd-9826-03434f915c41', 'volume_size': 1} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:26 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901" returned: 0 in 0.458s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:26 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901 Sep 11 14:07:26 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:27 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 1073741824" returned: 0 in 0.526s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:27 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b9562e01-7e91-4e5d-b4c3-faf3cda78901" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-b9562e01-7e91-4e5d-b4c3-faf3cda78901" released by "delete_volume" :: held 0.826s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:27 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 Sep 11 14:07:27 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Created reservations ['7245fde8-c55e-4736-84d8-f55aeae178ee', 'de4dd8dd-f637-4ff7-ae04-88ea813e4369', '9ea2b51e-ba81-403d-abd7-c81b25f3edd4', '396a912f-f794-4d9d-aacb-32ac8bf65e88'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:27 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:27 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:27 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8" returned: 0 in 0.306s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534189620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1058e62b-c912-4edd-9826-03434f915c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b45d559ccb4d9d85136c94c3c87461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:26Z,use_quota=True,user_id='4c99588ff42243a087e78275be7cc0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Creating volume 1058e62b-c912-4edd-9826-03434f915c41 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:27 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:27 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 1073741824 Sep 11 14:07:27 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6b8172-63cd-4002-93af-d0f6bed36a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0920654c-442e-478c-8b04-48975cabbd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:27 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 (bf8d1fec-adbd-4899-b580-d72d7e7730f8): created successfully Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0920654c-442e-478c-8b04-48975cabbd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (7f10735b-2a15-42c9-86c3-dd21d051ec35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-68ea9586-e8ad-4820-b716-fd54e081fc07 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created volume successfully. Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "cinder-quobyte-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:27 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.339s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f686d07-4885-44d6-8cba-94b6ff63ad17]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Deleted volume successfully. Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9a9f4d8b-b1d2-4422-b34b-52872c24ee1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-b9562e01-7e91-4e5d-b4c3-faf3cda78901-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:27 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce Sep 11 14:07:27 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:27 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 1073741824" returned: 0 in 0.505s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:28 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 Sep 11 14:07:28 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:28 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (ee3cbf3c-fbdc-427f-be19-e226b2488fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56dbdf8-9680-48b7-8a2c-87d3f05cc8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" returned: 0 in 0.456s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56dbdf8-9680-48b7-8a2c-87d3f05cc8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897507977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530f5987-7601-4925-b711-0669653d5994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:28Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:28 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce Sep 11 14:07:28 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3649d3-03aa-4ac5-a9b0-b166ceb91929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3649d3-03aa-4ac5-a9b0-b166ceb91929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c79610f-723f-4a4f-932e-edfcf662ca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c79610f-723f-4a4f-932e-edfcf662ca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530f5987-7601-4925-b711-0669653d5994', 'volume_name': 'volume-530f5987-7601-4925-b711-0669653d5994', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da6b9c3-e9f8-4549-afc0-fac5088c42b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da6b9c3-e9f8-4549-afc0-fac5088c42b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0104b76d-22e9-4b3d-ae73-831bb55fe1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume 530f5987-7601-4925-b711-0669653d5994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530f5987-7601-4925-b711-0669653d5994', 'volume_size': 1} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:28 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897507977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530f5987-7601-4925-b711-0669653d5994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:28Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Creating volume 530f5987-7601-4925-b711-0669653d5994 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:28 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:28 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8e913b-5bb3-4ffe-b034-c13e17d1728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1058e62b-c912-4edd-9826-03434f915c41', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:28 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 1073741824 Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaf33bc-0eac-4af6-b521-4cbf444184fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:28 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" returned: 0 in 0.299s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:28 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Volume volume-1058e62b-c912-4edd-9826-03434f915c41 (1058e62b-c912-4edd-9826-03434f915c41): created successfully Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaf33bc-0eac-4af6-b521-4cbf444184fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Flow 'volume_create_manager' (bca81c30-a26e-4e3d-80e7-41b169091f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-quobyte-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce" released by "delete_volume" :: held 0.824s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-641b1e5d-9971-42e8-8f98-28ab616a9192 tempest-ProjectReaderTests-2130697648 None] Created volume successfully. Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Created reservations ['e52557b8-a25c-4d9e-a1d4-4535f6d6dd20', '0e2d4c20-b4db-47da-9ed0-85a291d7410e', '9b689d7c-d13f-445d-aaa4-eb0d6baf571b', 'fb311cb4-8986-4815-ab6d-c7aae12d5fc1'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:28 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:28 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:28 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 1073741824" returned: 0 in 0.473s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:28 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 Sep 11 14:07:28 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:28 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:28 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Deleted volume successfully. Sep 11 14:07:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a2ccfc36-0978-48b1-85e2-54212d7a0c1b tempest-VolumeDependencyTests-1432579454 None] Lock "cinder-0e5f823c-fbd8-49b1-b0b6-7dbf7ba04bce-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:29 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.447s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0104b76d-22e9-4b3d-ae73-831bb55fe1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530f5987-7601-4925-b711-0669653d5994', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22fc13b-0064-401e-9ca1-aa734384d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating offline snapshot 78f18870-671b-4cbe-acea-8727b4c4d9f8 of volume bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:07:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume volume-530f5987-7601-4925-b711-0669653d5994 (530f5987-7601-4925-b711-0669653d5994): created successfully Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22fc13b-0064-401e-9ca1-aa734384d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (ee3cbf3c-fbdc-427f-be19-e226b2488fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6cdee9-2661-467a-8d00-428f1b4c418c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-12a71c5f-e339-421c-8ca4-f10182febf73 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created volume successfully. Sep 11 14:07:29 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 Sep 11 14:07:29 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:29 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:29 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 1G Sep 11 14:07:29 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "cinder-1058e62b-c912-4edd-9826-03434f915c41-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Lock "cinder-1058e62b-c912-4edd-9826-03434f915c41-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "cinder-quobyte-1058e62b-c912-4edd-9826-03434f915c41" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Lock "cinder-quobyte-1058e62b-c912-4edd-9826-03434f915c41" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dd0c79-b9a6-49eb-92fc-335ce74910eb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:29 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 Sep 11 14:07:29 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:29 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 1G" returned: 0 in 0.436s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:29 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 Sep 11 14:07:29 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:30 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41" returned: 0 in 0.474s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:30 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41 Sep 11 14:07:30 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:30 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:30 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 is being set with open permissions: ugo+rw Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:30 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 Sep 11 14:07:30 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:30 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8" returned: 0 in 0.350s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:30 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1058e62b-c912-4edd-9826-03434f915c41" returned: 0 in 0.403s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Lock "cinder-quobyte-1058e62b-c912-4edd-9826-03434f915c41" released by "delete_volume" :: held 0.934s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (6c4ee02b-7b7d-4a9f-826b-9cc4075cc6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f333f8c-2c9c-4038-a4e9-91de26756eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f333f8c-2c9c-4038-a4e9-91de26756eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874551258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d44b330-0652-49b6-91f9-303e88c4bde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:31Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4b9b9f-4455-4542-a032-4ac0f72a69bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4b9b9f-4455-4542-a032-4ac0f72a69bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27c4150-eb75-4d87-8a11-59c28deb24f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27c4150-eb75-4d87-8a11-59c28deb24f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d44b330-0652-49b6-91f9-303e88c4bde2', 'volume_name': 'volume-1d44b330-0652-49b6-91f9-303e88c4bde2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b10e0a5-0db9-4442-a99a-4930aa9ea01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b10e0a5-0db9-4442-a99a-4930aa9ea01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5e063c-98be-4e07-b3ce-a23abb688048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:30 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume 1d44b330-0652-49b6-91f9-303e88c4bde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d44b330-0652-49b6-91f9-303e88c4bde2', 'volume_size': 1} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:30 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info Sep 11 14:07:30 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:30 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Created reservations ['e911553c-0ab6-4881-a116-fe021360fbaa', '17502174-0336-4bd8-a59e-77949289da57', 'c2f8af3e-03ac-40ac-96db-1696587ac077', '2130d5dd-389f-4119-8b1c-3933396da73a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:31 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:31 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (1a92de4d-67f4-4be5-a0d8-bf68e5100ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfd062d-1927-4931-9fcd-5f124f60085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfd062d-1927-4931-9fcd-5f124f60085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641600950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57edf4b6-4d99-4d3c-9b71-711248c097ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:31Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f75d86-c673-48c0-96ec-38a791c8071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f75d86-c673-48c0-96ec-38a791c8071c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf9b5d2-3111-46f9-8567-c507b2673f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf9b5d2-3111-46f9-8567-c507b2673f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57edf4b6-4d99-4d3c-9b71-711248c097ca', 'volume_name': 'volume-57edf4b6-4d99-4d3c-9b71-711248c097ca', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0de7fef-99b2-460a-81b9-59c01213a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0de7fef-99b2-460a-81b9-59c01213a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f39ff5-6b5e-4d77-8a41-42badbb8fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume 57edf4b6-4d99-4d3c-9b71-711248c097ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57edf4b6-4d99-4d3c-9b71-711248c097ca', 'volume_size': 1} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:31 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info" returned: 0 in 0.443s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:31 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info is being set with open permissions: ugo+rw Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:31 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info Sep 11 14:07:31 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:31 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Deleted volume successfully. Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8f6bfb14-7b1c-4e26-bf5f-6accc92716b6 tempest-ProjectReaderTests-2130697648 None] Lock "cinder-1058e62b-c912-4edd-9826-03434f915c41-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:31 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (b3f1c54a-b8e5-4c52-86c4-b8cec3c66bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f7d4c9-c91c-4260-a117-059ee6b0e05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.info" returned: 0 in 0.360s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874551258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d44b330-0652-49b6-91f9-303e88c4bde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:31Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Creating volume 1d44b330-0652-49b6-91f9-303e88c4bde2 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:31 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:31 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 1073741824 Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f7d4c9-c91c-4260-a117-059ee6b0e05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518775652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22bb78cd-091a-4093-a539-7e53619e3cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:32Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251e74a-a885-45f7-b191-7cd792116c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251e74a-a885-45f7-b191-7cd792116c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4581738c-0bdc-498f-9c82-8f1790101e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4581738c-0bdc-498f-9c82-8f1790101e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22bb78cd-091a-4093-a539-7e53619e3cf7', 'volume_name': 'volume-22bb78cd-091a-4093-a539-7e53619e3cf7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae021812-7eb0-47e1-991f-0b0186b13cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae021812-7eb0-47e1-991f-0b0186b13cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329e72dd-9ebc-48b0-b548-3a0954b67cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:31 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume 22bb78cd-091a-4093-a539-7e53619e3cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22bb78cd-091a-4093-a539-7e53619e3cf7', 'volume_size': 1} Sep 11 14:07:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5de0d93f-0ff2-468f-b880-0fd573c7afdf tempest-CreateVolumesFromSnapshotTest-865286340 None] Create snapshot completed successfully Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (5bdb8467-ccf1-44d2-891e-009b56be9fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c72eeb-016e-4592-9458-6bc83802f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c72eeb-016e-4592-9458-6bc83802f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-851693123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986676c4-2339-4d29-9cbd-1cc9f8bd2221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:32Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e4b837-20a4-49fd-ab53-84fb5f022408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e4b837-20a4-49fd-ab53-84fb5f022408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd07b7e-c986-4a5a-b41b-068ea4c4b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd07b7e-c986-4a5a-b41b-068ea4c4b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986676c4-2339-4d29-9cbd-1cc9f8bd2221', 'volume_name': 'volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbfd8f1-e992-42f2-aa01-00aab327321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbfd8f1-e992-42f2-aa01-00aab327321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aa0593-1ab1-4461-a6de-47a20acc5b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume 986676c4-2339-4d29-9cbd-1cc9f8bd2221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221', 'volume_size': 1} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:32 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 1073741824" returned: 0 in 0.572s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:32 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 Sep 11 14:07:32 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:32 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2" returned: 0 in 0.306s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641600950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57edf4b6-4d99-4d3c-9b71-711248c097ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:31Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Creating volume 57edf4b6-4d99-4d3c-9b71-711248c097ca {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:32 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:32 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca 1073741824 Sep 11 14:07:32 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5e063c-98be-4e07-b3ce-a23abb688048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d44b330-0652-49b6-91f9-303e88c4bde2', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50a10e8-c0fd-4979-a04d-927c1aeda29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:32 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume volume-1d44b330-0652-49b6-91f9-303e88c4bde2 (1d44b330-0652-49b6-91f9-303e88c4bde2): created successfully Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50a10e8-c0fd-4979-a04d-927c1aeda29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (6c4ee02b-7b7d-4a9f-826b-9cc4075cc6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b0cc4591-deda-43ab-9963-23ac701275fb tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created volume successfully. Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (1619986e-aac8-4cf7-bee7-9368ebfc1e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e339a5fe-cd53-400e-809f-f8d06c446df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e339a5fe-cd53-400e-809f-f8d06c446df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324568780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1dfac8-9f5d-40d1-8434-7fde0806bfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:33Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f9b293-3081-4c54-8d15-985862a26dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f9b293-3081-4c54-8d15-985862a26dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5253a85f-3d8a-4a25-9f60-e1bab7ac265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5253a85f-3d8a-4a25-9f60-e1bab7ac265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1dfac8-9f5d-40d1-8434-7fde0806bfa4', 'volume_name': 'volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f2ab2e-0e95-4a51-8140-9d6e4eaf95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f2ab2e-0e95-4a51-8140-9d6e4eaf95c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd887b09-5756-42eb-83f0-cd984e2f4be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume 3b1dfac8-9f5d-40d1-8434-7fde0806bfa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4', 'volume_size': 1} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Flow 'volume_create_manager' (a5b76986-d455-458c-b327-46c9529d2125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487f68b7-2a9b-47a8-bfd1-710ad52255f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487f68b7-2a9b-47a8-bfd1-710ad52255f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226264207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b858ff6-a345-4df9-8259-28a492ee25ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b45d559ccb4d9d85136c94c3c87461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:33Z,use_quota=True,user_id='4c99588ff42243a087e78275be7cc0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccac599-1cad-4741-9445-c85c16854ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccac599-1cad-4741-9445-c85c16854ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc0c0fa-1a0d-4e6f-8048-dd8130b47787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc0c0fa-1a0d-4e6f-8048-dd8130b47787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b858ff6-a345-4df9-8259-28a492ee25ec', 'volume_name': 'volume-7b858ff6-a345-4df9-8259-28a492ee25ec', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3923df56-a5b0-40f3-85ab-28a90ee59568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3923df56-a5b0-40f3-85ab-28a90ee59568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e5d353-f664-478e-91d0-78294db5b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Volume 7b858ff6-a345-4df9-8259-28a492ee25ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b858ff6-a345-4df9-8259-28a492ee25ec', 'volume_size': 1} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:33 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca 1073741824" returned: 0 in 0.614s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:33 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca Sep 11 14:07:33 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (29387d0b-f5fe-44dd-88e5-8342211b1910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edc2520-5855-4463-8998-0694f2372e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edc2520-5855-4463-8998-0694f2372e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591907290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee7c2de-3b40-4a7f-b52f-2a923ba6221b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:33Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850bb4df-cb9d-465a-9a19-93f40996813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850bb4df-cb9d-465a-9a19-93f40996813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35151147-7920-48b4-b060-5fcd14d20434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35151147-7920-48b4-b060-5fcd14d20434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee7c2de-3b40-4a7f-b52f-2a923ba6221b', 'volume_name': 'volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce673bd8-8b62-47fc-af17-64bd8323b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce673bd8-8b62-47fc-af17-64bd8323b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2cafa8-497c-4ddd-b622-9c092f526c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume eee7c2de-3b40-4a7f-b52f-2a923ba6221b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b', 'volume_size': 1} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:33 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca" returned: 0 in 0.325s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518775652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22bb78cd-091a-4093-a539-7e53619e3cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:32Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Creating volume 22bb78cd-091a-4093-a539-7e53619e3cf7 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:33 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:33 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 1073741824 Sep 11 14:07:33 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f39ff5-6b5e-4d77-8a41-42badbb8fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57edf4b6-4d99-4d3c-9b71-711248c097ca', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fa37e5-f4b6-41c3-aba5-218636b3ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume volume-57edf4b6-4d99-4d3c-9b71-711248c097ca (57edf4b6-4d99-4d3c-9b71-711248c097ca): created successfully Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fa37e5-f4b6-41c3-aba5-218636b3ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (1a92de4d-67f4-4be5-a0d8-bf68e5100ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:33 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b959e5fb-547f-445a-bb22-8368d603de4d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created volume successfully. Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (81a164c3-3a02-4e2a-b63a-05d521f76609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5734bcd1-d60d-4316-a6d0-7be61e040c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5734bcd1-d60d-4316-a6d0-7be61e040c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104016670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5baea53b-9df2-4aee-8d57-fa1ad5264cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:34Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20731f6-708d-4be2-a239-b8fd2d357d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20731f6-708d-4be2-a239-b8fd2d357d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47b975c-62e4-4002-be35-1105b4cf4237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47b975c-62e4-4002-be35-1105b4cf4237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5baea53b-9df2-4aee-8d57-fa1ad5264cd9', 'volume_name': 'volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc01e74-9c75-4617-b80e-2d7ddb54f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc01e74-9c75-4617-b80e-2d7ddb54f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95da6cd4-70e9-4b95-8902-37ab25a15773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume 5baea53b-9df2-4aee-8d57-fa1ad5264cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9', 'volume_size': 1} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c0c46b64-f719-4446-82cf-ca29fb95805c tempest-ProjectAdminTests-814751693 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2129020690918, 'free_capacity_gb': 1773.2129020690918, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 14:07:34 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (e3ae1094-b457-4c1b-84a5-42e5572d8e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877ed43-050b-4d6d-b742-8773e4f46347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 1073741824" returned: 0 in 0.664s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877ed43-050b-4d6d-b742-8773e4f46347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1682953366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdae6acb-3c16-4fdf-ba86-66b111d42e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:34Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b074eb8-d9dc-4088-aa80-3b94ddb882fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b074eb8-d9dc-4088-aa80-3b94ddb882fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785e5658-e206-478b-a5a9-9ee17319b746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785e5658-e206-478b-a5a9-9ee17319b746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdae6acb-3c16-4fdf-ba86-66b111d42e48', 'volume_name': 'volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4983474-53fa-445f-80fa-71446158518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4983474-53fa-445f-80fa-71446158518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec1695f-2979-4a77-af6a-1c69b4d20fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume fdae6acb-3c16-4fdf-ba86-66b111d42e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48', 'volume_size': 1} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:34 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 Sep 11 14:07:34 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (475b44cd-dbbc-4fc7-84f6-4e09a526f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359198a5-0b41-4008-9ced-f25bed557218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359198a5-0b41-4008-9ced-f25bed557218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898732081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13aaf1bb-4291-4204-add8-3d9ced3386b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:35Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04abd63e-3896-47d2-891d-99139019e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04abd63e-3896-47d2-891d-99139019e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35581b51-7115-4da8-8126-fe19a21938b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35581b51-7115-4da8-8126-fe19a21938b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13aaf1bb-4291-4204-add8-3d9ced3386b5', 'volume_name': 'volume-13aaf1bb-4291-4204-add8-3d9ced3386b5', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a692c-65b7-4dc2-bbb4-27cb459188e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a692c-65b7-4dc2-bbb4-27cb459188e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9880fe-ea1f-4419-8a70-4acf128ea5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume 13aaf1bb-4291-4204-add8-3d9ced3386b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13aaf1bb-4291-4204-add8-3d9ced3386b5', 'volume_size': 1} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7" returned: 0 in 0.377s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-851693123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986676c4-2339-4d29-9cbd-1cc9f8bd2221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:32Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Creating volume 986676c4-2339-4d29-9cbd-1cc9f8bd2221 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:34 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329e72dd-9ebc-48b0-b548-3a0954b67cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22bb78cd-091a-4093-a539-7e53619e3cf7', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 1073741824 Sep 11 14:07:34 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58055d5e-8011-4cf3-b771-ec53bf8cff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:34 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume volume-22bb78cd-091a-4093-a539-7e53619e3cf7 (22bb78cd-091a-4093-a539-7e53619e3cf7): created successfully Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58055d5e-8011-4cf3-b771-ec53bf8cff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:34 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (b3f1c54a-b8e5-4c52-86c4-b8cec3c66bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7e01fde3-5922-429c-b4f4-baccef2d16e2 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created volume successfully. Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (735c6c13-d4b8-44a1-81bd-0fb0a94b1aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d04b88-d910-44d5-9c71-42fd7839c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d04b88-d910-44d5-9c71-42fd7839c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129429063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360b3122-9170-4a3d-bad6-819068f10018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:35Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9efa55b-667b-42df-906b-74700b3789b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9efa55b-667b-42df-906b-74700b3789b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd9be98-5084-425c-b0da-788f69c579fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd9be98-5084-425c-b0da-788f69c579fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360b3122-9170-4a3d-bad6-819068f10018', 'volume_name': 'volume-360b3122-9170-4a3d-bad6-819068f10018', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d3a5cf-97ca-4e9c-84fb-a81d63660107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d3a5cf-97ca-4e9c-84fb-a81d63660107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdcbffc3-25ee-4a72-a17a-cac35b229b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:35 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume 360b3122-9170-4a3d-bad6-819068f10018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360b3122-9170-4a3d-bad6-819068f10018', 'volume_size': 1} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:35 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 1073741824" returned: 0 in 0.541s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:35 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 Sep 11 14:07:35 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:35 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221" returned: 0 in 0.254s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.541s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324568780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1dfac8-9f5d-40d1-8434-7fde0806bfa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56154e4cf5a44786ad2383a9da0580f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:33Z,use_quota=True,user_id='0e39a7a5c2574f309f3ccc51bed63bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Creating volume 3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:35 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:35 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 1073741824 Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aa0593-1ab1-4461-a6de-47a20acc5b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:35 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3473d1-ce53-410f-b62f-815f4a58e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:35 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 (986676c4-2339-4d29-9cbd-1cc9f8bd2221): created successfully Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3473d1-ce53-410f-b62f-815f4a58e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (5bdb8467-ccf1-44d2-891e-009b56be9fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-fc99353d-7faa-44e5-8fc4-18aebd51b7bf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created volume successfully. Sep 11 14:07:36 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 1073741824" returned: 0 in 0.559s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:36 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 Sep 11 14:07:36 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:36 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.296s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226264207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b858ff6-a345-4df9-8259-28a492ee25ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b45d559ccb4d9d85136c94c3c87461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:33Z,use_quota=True,user_id='4c99588ff42243a087e78275be7cc0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Creating volume 7b858ff6-a345-4df9-8259-28a492ee25ec {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:36 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:36 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec 1073741824 Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd887b09-5756-42eb-83f0-cd984e2f4be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:36 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c26314-3a59-4145-a7e3-b906752a2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:36 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Volume volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 (3b1dfac8-9f5d-40d1-8434-7fde0806bfa4): created successfully Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c26314-3a59-4145-a7e3-b906752a2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Flow 'volume_create_manager' (1619986e-aac8-4cf7-bee7-9368ebfc1e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4672e5e0-72d8-4312-9708-1b33542eacc8 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created volume successfully. Sep 11 14:07:36 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec 1073741824" returned: 0 in 0.441s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:37 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec Sep 11 14:07:37 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:37 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec" returned: 0 in 0.254s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.715s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591907290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee7c2de-3b40-4a7f-b52f-2a923ba6221b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:33Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating volume eee7c2de-3b40-4a7f-b52f-2a923ba6221b {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:37 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e5d353-f664-478e-91d0-78294db5b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b858ff6-a345-4df9-8259-28a492ee25ec', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:37 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b 1073741824 Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39258a67-c103-4bb9-935b-8afc016e344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:37 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:37 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Volume volume-7b858ff6-a345-4df9-8259-28a492ee25ec (7b858ff6-a345-4df9-8259-28a492ee25ec): created successfully Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39258a67-c103-4bb9-935b-8afc016e344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Flow 'volume_create_manager' (a5b76986-d455-458c-b327-46c9529d2125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:37 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-1b157521-3cc7-472f-823d-7bf7757b3840 tempest-ProjectReaderTests-2130697648 None] Created volume successfully. Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-quobyte-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4599e3d-c3ea-46de-a926-7099f8cf551a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:37 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 Sep 11 14:07:37 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:37 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b 1073741824" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:37 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4" returned: 0 in 0.391s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:37 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:37 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:37 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4 Sep 11 14:07:37 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:38 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.147s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104016670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5baea53b-9df2-4aee-8d57-fa1ad5264cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:34Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating volume 5baea53b-9df2-4aee-8d57-fa1ad5264cd9 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:38 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2cafa8-497c-4ddd-b622-9c092f526c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a78f7e-1dd8-4c05-9690-a2801bf1a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Acquiring lock "cinder-7b858ff6-a345-4df9-8259-28a492ee25ec-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:38 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 1073741824 Sep 11 14:07:38 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:38 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b (eee7c2de-3b40-4a7f-b52f-2a923ba6221b): created successfully Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a78f7e-1dd8-4c05-9690-a2801bf1a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (29387d0b-f5fe-44dd-88e5-8342211b1910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Lock "cinder-7b858ff6-a345-4df9-8259-28a492ee25ec-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7ef1c30e-2afa-4d67-8b3c-b9d87a7685ba tempest-CreateVolumesFromSnapshotTest-865286340 None] Created volume successfully. Sep 11 14:07:38 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4" returned: 0 in 0.473s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Acquiring lock "cinder-quobyte-7b858ff6-a345-4df9-8259-28a492ee25ec" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4" released by "delete_volume" :: held 0.936s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Lock "cinder-quobyte-7b858ff6-a345-4df9-8259-28a492ee25ec" acquired by "delete_volume" :: waited 0.060s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cf049-f14a-44d3-a8b2-822c1c341314]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created reservations ['4515573a-97c7-4ab9-b4a4-5dca890b296d', 'b197f010-37a8-499c-a4d3-7d9c6d276325', '396c59ec-1e01-4f35-92dc-b0eda074b85b', 'd6a45ab3-d534-42c0-9738-508b91b623df'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:38 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec Sep 11 14:07:38 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (ec8460d5-726b-463d-9c95-106da4f16739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a11744-595c-4b76-ad3a-376d959a15a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a11744-595c-4b76-ad3a-376d959a15a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295591774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06f993-2ef3-4b60-bf71-88b85c8bb3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:39Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fe56e9-e820-4dd1-bbed-ef55a6f9e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fe56e9-e820-4dd1-bbed-ef55a6f9e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:38 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:38 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b264eff-8932-4343-a8ee-ad6af2d1f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b264eff-8932-4343-a8ee-ad6af2d1f048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a06f993-2ef3-4b60-bf71-88b85c8bb3c0', 'volume_name': 'volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:38 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9817c75-edcc-4863-b70f-3dfc27075977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9817c75-edcc-4863-b70f-3dfc27075977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1f2f06-dee2-47b9-ae78-593cab91e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:38 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Volume 1a06f993-2ef3-4b60-bf71-88b85c8bb3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0', 'volume_size': 1} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 1073741824" returned: 0 in 0.661s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:38 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 Sep 11 14:07:38 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:39 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec" returned: 0 in 0.491s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:39 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec Sep 11 14:07:39 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:39 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.314s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Deleted volume successfully. Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-aab2a837-069f-4890-989c-d11606d82120 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-3b1dfac8-9f5d-40d1-8434-7fde0806bfa4-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:39 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.778s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1682953366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdae6acb-3c16-4fdf-ba86-66b111d42e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:34Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating volume fdae6acb-3c16-4fdf-ba86-66b111d42e48 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:39 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95da6cd4-70e9-4b95-8902-37ab25a15773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef497584-f23c-4067-816c-e90bd334678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:39 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 1073741824 Sep 11 14:07:39 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:39 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 (5baea53b-9df2-4aee-8d57-fa1ad5264cd9): created successfully Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef497584-f23c-4067-816c-e90bd334678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (81a164c3-3a02-4e2a-b63a-05d521f76609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ce51a12e-6316-4b5e-9a83-5fb149cef8b3 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created volume successfully. Sep 11 14:07:39 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-7b858ff6-a345-4df9-8259-28a492ee25ec" returned: 0 in 0.279s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Lock "cinder-quobyte-7b858ff6-a345-4df9-8259-28a492ee25ec" released by "delete_volume" :: held 0.852s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Created reservations ['4e5504d6-f716-48d0-8d70-d5fcc4dc923a', 'ef122809-a6f7-4f62-b596-83f843d7d35c', 'a1d80d1c-7b17-44f6-8794-9bfb8f785347', '59ccf5bb-24c1-4266-b2f5-cb69ae4101bf'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:39 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:39 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:39 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:39 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.273s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 1073741824" returned: 0 in 0.544s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-986676c4-2339-4d29-9cbd-1cc9f8bd2221-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:39 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Deleted volume successfully. Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-986676c4-2339-4d29-9cbd-1cc9f8bd2221-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-69c8f0b8-5d71-4a8c-9e71-8ad9c7927aef tempest-ProjectReaderTests-2130697648 None] Lock "cinder-7b858ff6-a345-4df9-8259-28a492ee25ec-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-quobyte-986676c4-2339-4d29-9cbd-1cc9f8bd2221" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:39 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 Sep 11 14:07:39 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-986676c4-2339-4d29-9cbd-1cc9f8bd2221" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d10816c-d5d0-48fb-8211-3e8460d3bd4c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:39 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 Sep 11 14:07:39 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:40 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.288s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898732081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13aaf1bb-4291-4204-add8-3d9ced3386b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:35Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating volume 13aaf1bb-4291-4204-add8-3d9ced3386b5 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:40 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec1695f-2979-4a77-af6a-1c69b4d20fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:40 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 1073741824 Sep 11 14:07:40 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3550e4-1c66-47c2-b8f5-141761749141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:40 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 (fdae6acb-3c16-4fdf-ba86-66b111d42e48): created successfully Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3550e4-1c66-47c2-b8f5-141761749141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (e3ae1094-b457-4c1b-84a5-42e5572d8e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9450dcf3-bb9c-4d05-b4db-54b885495a03 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created volume successfully. Sep 11 14:07:40 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221" returned: 0 in 0.372s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:40 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221 Sep 11 14:07:40 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:40 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-986676c4-2339-4d29-9cbd-1cc9f8bd2221" returned: 0 in 0.258s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-986676c4-2339-4d29-9cbd-1cc9f8bd2221" released by "delete_volume" :: held 0.670s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:40 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 1073741824" returned: 0 in 0.432s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created reservations ['3016273f-29bd-4c0b-a1e1-92be89eab6a9', '3b2d6e27-5652-4b5e-befb-dbdbf31f1080', '7d8c8a19-8a83-4f38-9cf3-5a3ea68cb3ea', '42ea0c97-597e-486f-97a3-c1e8b2680b8c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:40 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 Sep 11 14:07:40 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:40 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:40 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:40 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5" returned: 0 in 0.325s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.620s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129429063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360b3122-9170-4a3d-bad6-819068f10018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af6f4ad8f364ec4954344c0216feea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:35Z,use_quota=True,user_id='3c980ad7b4a64dbf901d2f4a4e914bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Creating volume 360b3122-9170-4a3d-bad6-819068f10018 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:40 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-22bb78cd-091a-4093-a539-7e53619e3cf7-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:40 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 1073741824 Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9880fe-ea1f-4419-8a70-4acf128ea5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13aaf1bb-4291-4204-add8-3d9ced3386b5', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:40 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:40 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39d430f-adbc-4b7e-b6df-1c010f38dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.325s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-22bb78cd-091a-4093-a539-7e53619e3cf7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Deleted volume successfully. Sep 11 14:07:41 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 (13aaf1bb-4291-4204-add8-3d9ced3386b5): created successfully Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39d430f-adbc-4b7e-b6df-1c010f38dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (475b44cd-dbbc-4fc7-84f6-4e09a526f230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-0f1ff2a2-2c94-45b9-b519-e7f84b4c753d tempest-CreateVolumesFromSnapshotTest-865286340 None] Created volume successfully. Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-0becd877-3ac4-4824-be75-85b9bf3f26cf tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-986676c4-2339-4d29-9cbd-1cc9f8bd2221-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-quobyte-22bb78cd-091a-4093-a539-7e53619e3cf7" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-22bb78cd-091a-4093-a539-7e53619e3cf7" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5debb3e7-fe13-4a38-b5e4-8439e3800cee]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:41 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 Sep 11 14:07:41 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:41 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 1073741824" returned: 0 in 0.480s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:41 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 Sep 11 14:07:41 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:41 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7" returned: 0 in 0.411s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:41 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7 Sep 11 14:07:41 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:41 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018" returned: 0 in 0.299s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.915s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295591774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06f993-2ef3-4b60-bf71-88b85c8bb3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:39Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Creating volume 1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:41 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdcbffc3-25ee-4a72-a17a-cac35b229b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360b3122-9170-4a3d-bad6-819068f10018', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:41 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 1073741824 Sep 11 14:07:41 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cc7fe5-9aca-4d4d-917e-6abe3f9f6974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:41 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Volume volume-360b3122-9170-4a3d-bad6-819068f10018 (360b3122-9170-4a3d-bad6-819068f10018): created successfully Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cc7fe5-9aca-4d4d-917e-6abe3f9f6974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Flow 'volume_create_manager' (735c6c13-d4b8-44a1-81bd-0fb0a94b1aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-588bb4a8-b79f-407f-bd20-4fb2f9b17137 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created volume successfully. Sep 11 14:07:41 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-22bb78cd-091a-4093-a539-7e53619e3cf7" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-22bb78cd-091a-4093-a539-7e53619e3cf7" released by "delete_volume" :: held 0.772s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created reservations ['b21dcb16-a0be-4b79-91e0-a04ec9c6c9c2', '1c38ef08-88e1-41da-ba7f-5f45a7c512a9', '06927bd1-6abc-4644-ae87-1546c6f24c19', '5953f128-0562-4798-a0c5-745e819cc5d6'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-360b3122-9170-4a3d-bad6-819068f10018-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:42 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:42 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-360b3122-9170-4a3d-bad6-819068f10018-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-57edf4b6-4d99-4d3c-9b71-711248c097ca-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-360b3122-9170-4a3d-bad6-819068f10018" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-57edf4b6-4d99-4d3c-9b71-711248c097ca-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-360b3122-9170-4a3d-bad6-819068f10018" acquired by "delete_volume" :: waited 0.037s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c520df2f-5b47-4116-9811-cfc56adec116]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-quobyte-57edf4b6-4d99-4d3c-9b71-711248c097ca" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-57edf4b6-4d99-4d3c-9b71-711248c097ca" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e81a43-79dc-4e18-afe9-6907b9c03dde]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:42 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 1073741824" returned: 0 in 0.729s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:42 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 Sep 11 14:07:42 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:42 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.481s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:42 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 Sep 11 14:07:42 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Deleted volume successfully. Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-ce8fe127-c9da-4446-91d5-3257589d2921 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-22bb78cd-091a-4093-a539-7e53619e3cf7-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:42 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca Sep 11 14:07:42 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:42 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" returned: 0 in 0.306s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1f2f06-dee2-47b9-ae78-593cab91e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d8b52e-ff83-49be-95c0-5b6cf459f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:42 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Volume volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 (1a06f993-2ef3-4b60-bf71-88b85c8bb3c0): created successfully Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d8b52e-ff83-49be-95c0-5b6cf459f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (ec8460d5-726b-463d-9c95-106da4f16739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:42 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018" returned: 0 in 0.560s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:42 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-342ce28c-99d9-4016-9e06-6c10f5b0cd27 tempest-ProjectReaderTests-840254707 None] Created volume successfully. Sep 11 14:07:42 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018 Sep 11 14:07:42 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:42 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca" returned: 0 in 0.536s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:43 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca Sep 11 14:07:43 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:43 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-360b3122-9170-4a3d-bad6-819068f10018" returned: 0 in 0.288s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-360b3122-9170-4a3d-bad6-819068f10018" released by "delete_volume" :: held 0.920s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:43 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-57edf4b6-4d99-4d3c-9b71-711248c097ca" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-57edf4b6-4d99-4d3c-9b71-711248c097ca" released by "delete_volume" :: held 0.871s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['f5f8a9dc-7031-489a-9db1-4fd533d702c0', 'be3f517b-32fd-4996-bb82-2b4e727b3d35', 'b9bb2afd-566c-46fa-8c34-7ac794b45ed1', 'c9b999be-cbb4-4c98-86c4-62e2a3b8dd82'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created reservations ['144d45db-e881-4d45-b835-7b9eacca3eba', '93f3b4ad-ecaf-44f3-bfb5-72859dae9d4a', 'ff2be91a-baa2-4b2f-be83-ea637f78fac2', 'e59dedf9-3b59-4011-a4a9-25d54ba3e84f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:43 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:43 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:43 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:43 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:43 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleted volume successfully. Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f0b6c138-a39c-4012-88ba-7caeed96127c tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-360b3122-9170-4a3d-bad6-819068f10018-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:43 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Deleted volume successfully. Sep 11 14:07:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-998370be-8143-45fb-8830-8fb802f4ca3d tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-57edf4b6-4d99-4d3c-9b71-711248c097ca-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Creating offline snapshot 4e89fb9a-28ed-447f-a273-b05b787da97d of volume 1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fc85f-fe3b-47cd-819a-701cd5a1dafb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:44 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 Sep 11 14:07:44 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-13aaf1bb-4291-4204-add8-3d9ced3386b5-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-13aaf1bb-4291-4204-add8-3d9ced3386b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:44 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" returned: 0 in 0.430s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-13aaf1bb-4291-4204-add8-3d9ced3386b5" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-1d44b330-0652-49b6-91f9-303e88c4bde2-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:44 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d 1G Sep 11 14:07:44 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-13aaf1bb-4291-4204-add8-3d9ced3386b5" acquired by "delete_volume" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-1d44b330-0652-49b6-91f9-303e88c4bde2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7e367-b12f-42be-8693-99a0b3b32842]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-quobyte-1d44b330-0652-49b6-91f9-303e88c4bde2" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-1d44b330-0652-49b6-91f9-303e88c4bde2" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c9b95b-4e64-489d-b18b-c4f2ce114aa7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:44 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 Sep 11 14:07:44 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:44 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 Sep 11 14:07:44 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d 1G" returned: 0 in 0.525s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d Sep 11 14:07:45 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5" returned: 0 in 0.514s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5 Sep 11 14:07:45 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2" returned: 0 in 0.566s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2 Sep 11 14:07:45 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d" returned: 0 in 0.369s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d is being set with open permissions: ugo+rw Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d Sep 11 14:07:45 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-13aaf1bb-4291-4204-add8-3d9ced3386b5" returned: 0 in 0.325s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-13aaf1bb-4291-4204-add8-3d9ced3386b5" released by "delete_volume" :: held 0.913s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['26b48443-4189-4897-844a-d413c989450c', '52aca9fe-37f4-4273-a94d-5eaaf1476494', '89877a5e-d673-4654-9da6-adb3def9025b', 'd105ade1-0433-434f-a550-e52964bdaf2c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:45 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1d44b330-0652-49b6-91f9-303e88c4bde2" returned: 0 in 0.327s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-1d44b330-0652-49b6-91f9-303e88c4bde2" released by "delete_volume" :: held 0.945s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created reservations ['010c8d24-43fa-429c-a2b2-284bc2220e6d', '20b913e1-8882-45e1-9417-603a2024a1e8', 'd59a80af-9565-4b32-b1d2-85e24a9bb006', 'e43c25bf-edcc-47b8-b8b3-b85d1a63e182'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:45 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:45 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:45 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:45 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info Sep 11 14:07:45 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:46 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.314s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleted volume successfully. Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-72c03f76-ee89-41a3-b2d3-ba377a76d605 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-13aaf1bb-4291-4204-add8-3d9ced3386b5-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:46 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.322s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Deleted volume successfully. Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e9036ab4-94ea-4553-be51-401589692901 tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-1d44b330-0652-49b6-91f9-303e88c4bde2-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:46 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info" returned: 0 in 0.324s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:46 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info is being set with open permissions: ugo+rw Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:46 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info Sep 11 14:07:46 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:46 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.info" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4c85a5df-7c1f-42b0-ac76-7c9bd38a1e85 tempest-ProjectReaderTests-840254707 None] Create snapshot completed successfully Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-fdae6acb-3c16-4fdf-ba86-66b111d42e48-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-fdae6acb-3c16-4fdf-ba86-66b111d42e48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-fdae6acb-3c16-4fdf-ba86-66b111d42e48" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-fdae6acb-3c16-4fdf-ba86-66b111d42e48" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d734d8-01bf-46ea-9015-46e6e2fc4a48]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-530f5987-7601-4925-b711-0669653d5994-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-530f5987-7601-4925-b711-0669653d5994-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "cinder-quobyte-530f5987-7601-4925-b711-0669653d5994" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:46 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 Sep 11 14:07:46 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-530f5987-7601-4925-b711-0669653d5994" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c2cc4-7ba6-4d9c-9e80-61ca0d7300a1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:47 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 Sep 11 14:07:47 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:47 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48" returned: 0 in 0.461s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:47 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48 Sep 11 14:07:47 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:47 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994" returned: 0 in 0.454s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:47 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994 Sep 11 14:07:47 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-4e89fb9a-28ed-447f-a273-b05b787da97d-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-4e89fb9a-28ed-447f-a273-b05b787da97d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:47 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-fdae6acb-3c16-4fdf-ba86-66b111d42e48" returned: 0 in 0.330s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-fdae6acb-3c16-4fdf-ba86-66b111d42e48" released by "delete_volume" :: held 0.846s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-4e89fb9a-28ed-447f-a273-b05b787da97d" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-4e89fb9a-28ed-447f-a273-b05b787da97d" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Deleting offline snapshot 4e89fb9a-28ed-447f-a273-b05b787da97d of volume 1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] snapshot_file for this snap is: volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5b9c7-7e25-4303-ace3-15cc89a273ef]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['c15bbc1c-74b7-4bb0-b164-e7232d90333a', 'af56d179-064f-4867-b290-a7d17993cc8b', 'a254dc5b-9b21-4c3e-a4e6-51136b56d8cf', '760e762f-8716-4ed4-a17a-9eabad675a36'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:47 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-530f5987-7601-4925-b711-0669653d5994" returned: 0 in 0.458s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:47 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d Sep 11 14:07:47 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:47 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:47 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-quobyte-530f5987-7601-4925-b711-0669653d5994" released by "delete_volume" :: held 0.970s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Created reservations ['737a10bf-4e7d-4ccc-b051-6f6bf3f32994', 'f1873b4b-cb3b-4b4d-b08b-b5155f54c01e', '1602bc85-e4b6-4d16-aced-b45b4d41c19d', 'a4c9807d-f20e-4cdc-9bb5-f2680f6df217'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:48 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:48 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:48 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d" returned: 0 in 0.464s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe076e2-5436-4288-a37e-a56be729f5dd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:48 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.406s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleted volume successfully. Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-66f86d44-4c1d-4392-a82f-85218622caad tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-fdae6acb-3c16-4fdf-ba86-66b111d42e48-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:48 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 Sep 11 14:07:48 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:48 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.273s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:48 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Deleted volume successfully. Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4d88180f-f789-4f8a-ad2d-b495773c563a tempest-CreateVolumesFromSourceVolumeTest-1474512163 None] Lock "cinder-530f5987-7601-4925-b711-0669653d5994-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:48 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" returned: 0 in 0.391s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:48 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d Sep 11 14:07:48 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-5baea53b-9df2-4aee-8d57-fa1ad5264cd9-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-5baea53b-9df2-4aee-8d57-fa1ad5264cd9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:49 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d" returned: 0 in 0.519s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:49 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d Sep 11 14:07:49 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-5baea53b-9df2-4aee-8d57-fa1ad5264cd9" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-5baea53b-9df2-4aee-8d57-fa1ad5264cd9" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2edb08-bb20-4ca8-842e-f1444c505dcb]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:49 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0.4e89fb9a-28ed-447f-a273-b05b787da97d" returned: 0 in 0.344s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-4e89fb9a-28ed-447f-a273-b05b787da97d" released by "_delete_snapshot" :: held 1.850s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:49 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 Sep 11 14:07:49 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" released by "delete_snapshot" :: held 1.914s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Created reservations ['833665fa-419e-41fa-9045-fe1156c2bacd', '06263771-d9d2-4660-9b86-2c0608b9995b', 'ceaa7e64-f1eb-4e91-be4f-eb31de016ac5', '01a535cd-4a59-49c6-b315-2ab88ebdb88d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Delete snapshot completed successfully. Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9de9f7e3-fb4e-49be-b44a-144172d0e5f8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-4e89fb9a-28ed-447f-a273-b05b787da97d-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Lock "cinder-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:49 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9" returned: 0 in 0.645s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a608de-04d1-4194-8147-84a3092cec7d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:50 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9 Sep 11 14:07:50 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:50 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 Sep 11 14:07:50 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:50 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-5baea53b-9df2-4aee-8d57-fa1ad5264cd9" returned: 0 in 0.319s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-5baea53b-9df2-4aee-8d57-fa1ad5264cd9" released by "delete_volume" :: held 1.036s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['aa4d7a51-b178-4e5a-a333-599e0532d5ee', '1d17221f-4911-464a-9ff1-dce46a791256', '3ea47a44-f721-4d6f-9ea4-1654e7195e4d', 'dbc08de5-005d-45af-83c4-cc33fcc08b2d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:50 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" returned: 0 in 0.524s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:50 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:50 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:50 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0 Sep 11 14:07:50 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:50 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" returned: 0 in 0.309s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:50 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.374s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:50 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleted volume successfully. Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0" released by "delete_volume" :: held 0.943s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ac90cd4-2969-42d9-a486-f290e7c0973f tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-5baea53b-9df2-4aee-8d57-fa1ad5264cd9-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:50 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Created reservations ['8f5c04ee-5b7d-4e05-88c8-994d3a32247d', '3e5216a3-d27e-4275-b2d6-ac11374dc6bc', 'd4c74880-4f67-4bf4-823d-22dc86314b7d', 'ea62ca7f-0bfb-48a8-bb5e-8e0119d3171f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:51 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:51 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:51 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.268s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Deleted volume successfully. Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-de89839a-55cf-4f39-8c06-6da20a34b0cb tempest-ProjectReaderTests-840254707 None] Lock "cinder-1a06f993-2ef3-4b60-bf71-88b85c8bb3c0-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-eee7c2de-3b40-4a7f-b52f-2a923ba6221b-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-eee7c2de-3b40-4a7f-b52f-2a923ba6221b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-eee7c2de-3b40-4a7f-b52f-2a923ba6221b" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-eee7c2de-3b40-4a7f-b52f-2a923ba6221b" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[627be63f-1f07-44a0-9ce9-621b459436b2]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:51 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b Sep 11 14:07:51 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:52 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b" returned: 0 in 0.500s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:52 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b Sep 11 14:07:52 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:52 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-eee7c2de-3b40-4a7f-b52f-2a923ba6221b" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-eee7c2de-3b40-4a7f-b52f-2a923ba6221b" released by "delete_volume" :: held 0.954s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['5046d75b-ed5c-4f8a-a3f2-c4999f8dfbb5', 'b669d446-1b4f-4f3b-8afb-8f0889ca692a', '47d481b9-f89e-4499-9df2-90ee1a1ea336', '195d45b6-54fd-4216-b1e7-1551f574c03a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:52 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:52 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:52 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-78f18870-671b-4cbe-acea-8727b4c4d9f8-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-78f18870-671b-4cbe-acea-8727b4c4d9f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-bf8d1fec-adbd-4899-b580-d72d7e7730f8" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (cc952828-7e0d-482a-8891-e08ac92fa925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41108b98-4bfd-411e-8036-8da01de6ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41108b98-4bfd-411e-8036-8da01de6ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1843188538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e3cebb-6b85-44b5-b506-364cc7974d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:53Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02afb6c1-8965-4ef8-a4f7-5123ae831390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02afb6c1-8965-4ef8-a4f7-5123ae831390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaa49c7-61f9-4d12-811a-b310bb4857d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaa49c7-61f9-4d12-811a-b310bb4857d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e3cebb-6b85-44b5-b506-364cc7974d99', 'volume_name': 'volume-c7e3cebb-6b85-44b5-b506-364cc7974d99', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bd3659-3023-4ef6-ba02-a8875ef5df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bd3659-3023-4ef6-ba02-a8875ef5df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c159aeb0-7dac-45cc-96cf-7db9a1b89066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Volume c7e3cebb-6b85-44b5-b506-364cc7974d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e3cebb-6b85-44b5-b506-364cc7974d99', 'volume_size': 1} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1843188538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e3cebb-6b85-44b5-b506-364cc7974d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:53Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Creating volume c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:53 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-bf8d1fec-adbd-4899-b580-d72d7e7730f8" acquired by "delete_snapshot" :: waited 0.223s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-78f18870-671b-4cbe-acea-8727b4c4d9f8" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:53 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 1073741824 Sep 11 14:07:53 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleted volume successfully. Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-78f18870-671b-4cbe-acea-8727b4c4d9f8" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleting offline snapshot 78f18870-671b-4cbe-acea-8727b4c4d9f8 of volume bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] snapshot_file for this snap is: volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Flow 'volume_create_manager' (e8e2c20e-fe52-4c01-ab36-d26bedc919fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a722d98a-88c1-409a-b6c0-2e8866b0fe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea4ada-eca7-4fa3-ba18-93e2b43d5816]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f74ce5a1-c799-4d62-83af-87f7e5808da1 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-eee7c2de-3b40-4a7f-b52f-2a923ba6221b-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a722d98a-88c1-409a-b6c0-2e8866b0fe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3930c0-cdad-45be-bf14-4e312d1dc6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc63e85038cc4601b67c6b33e16291d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:53Z,use_quota=True,user_id='54fe95fa41434844b63be03615833cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cc3f88-59e3-438d-8eb7-2200d35ad900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cc3f88-59e3-438d-8eb7-2200d35ad900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b071b879-464c-4318-a9a5-d31fe7cd010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b071b879-464c-4318-a9a5-d31fe7cd010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3930c0-cdad-45be-bf14-4e312d1dc6b6', 'volume_name': 'volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a0ab54-0a7d-4272-8e92-8327e22fed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a0ab54-0a7d-4272-8e92-8327e22fed04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6b1e93-eb2f-4a89-9c19-0536546ad450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:53 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Volume 4c3930c0-cdad-45be-bf14-4e312d1dc6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6', 'volume_size': 1} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:53 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 Sep 11 14:07:53 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:53 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 1073741824" returned: 0 in 0.489s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:53 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 Sep 11 14:07:53 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:53 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8" returned: 0 in 0.446s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9a200-f916-4d3c-b57c-26c26a3231fe]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:54 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3930c0-cdad-45be-bf14-4e312d1dc6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc63e85038cc4601b67c6b33e16291d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:53Z,use_quota=True,user_id='54fe95fa41434844b63be03615833cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Creating volume 4c3930c0-cdad-45be-bf14-4e312d1dc6b6 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:54 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c159aeb0-7dac-45cc-96cf-7db9a1b89066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e3cebb-6b85-44b5-b506-364cc7974d99', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:54 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 Sep 11 14:07:54 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b067a1-642e-4fc9-9e9a-dc6ada1b9365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:54 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 1073741824 Sep 11 14:07:54 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:54 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Volume volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 (c7e3cebb-6b85-44b5-b506-364cc7974d99): created successfully Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b067a1-642e-4fc9-9e9a-dc6ada1b9365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (cc952828-7e0d-482a-8891-e08ac92fa925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:54 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a547a52c-8223-4d85-89d4-2d82e814f27d tempest-ProjectReaderTests-840254707 None] Created volume successfully. Sep 11 14:07:54 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8" returned: 0 in 0.483s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:54 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 Sep 11 14:07:54 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:54 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 1073741824" returned: 0 in 0.553s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:54 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 Sep 11 14:07:54 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:54 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8" returned: 0 in 0.428s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:54 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8 Sep 11 14:07:54 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:54 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6" returned: 0 in 0.321s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6b1e93-eb2f-4a89-9c19-0536546ad450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1809deac-6804-4a1f-a521-36fac4a5a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Volume volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 (4c3930c0-cdad-45be-bf14-4e312d1dc6b6): created successfully Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1809deac-6804-4a1f-a521-36fac4a5a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Flow 'volume_create_manager' (e8e2c20e-fe52-4c01-ab36-d26bedc919fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-95b434f2-804f-4cd3-a699-562df20bee48 tempest-CinderUnicodeTest-1856542836 None] Created volume successfully. Sep 11 14:07:55 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8.78f18870-671b-4cbe-acea-8727b4c4d9f8" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-78f18870-671b-4cbe-acea-8727b4c4d9f8" released by "_delete_snapshot" :: held 1.871s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-bf8d1fec-adbd-4899-b580-d72d7e7730f8" released by "delete_snapshot" :: held 1.958s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['cadb654a-7b54-4df6-9905-e7b363064afd', 'f13557cf-6fe2-49a3-aa52-53d37da65133', '875113b0-473b-4ce7-ae32-19faad0d84bf', '07372827-6636-4017-8c11-c339b2964e00'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Delete snapshot completed successfully. Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5aa68b92-f397-4da9-a33e-2de23456903d tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-78f18870-671b-4cbe-acea-8727b4c4d9f8-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Creating offline snapshot 8241802e-2db8-4528-bea2-017e62f818dd of volume c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b750adaa-ca40-45ed-9554-a7e3cc4b6db9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:55 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 Sep 11 14:07:55 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:56 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99" returned: 0 in 0.496s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:56 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd 1G Sep 11 14:07:56 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Flow 'volume_create_manager' (44975649-d906-4e71-beb1-ef0627de3ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cf4306-48c2-4f92-8464-d3b83872c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cf4306-48c2-4f92-8464-d3b83872c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2022214429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e332dd09-1816-4dab-948a-3c80e97f957d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc63e85038cc4601b67c6b33e16291d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:56Z,use_quota=True,user_id='54fe95fa41434844b63be03615833cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cc2f8a-5ed0-49eb-9533-c7f9507bf325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cc2f8a-5ed0-49eb-9533-c7f9507bf325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c10df3d-1ea2-40c8-9ff2-44f8c936d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c10df3d-1ea2-40c8-9ff2-44f8c936d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e332dd09-1816-4dab-948a-3c80e97f957d', 'volume_name': 'volume-e332dd09-1816-4dab-948a-3c80e97f957d', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a88df13-1f16-41c6-a980-f158c691cfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a88df13-1f16-41c6-a980-f158c691cfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614a344b-2a44-4219-860b-f41b202f251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Volume e332dd09-1816-4dab-948a-3c80e97f957d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e332dd09-1816-4dab-948a-3c80e97f957d', 'volume_size': 1} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-bf8d1fec-adbd-4899-b580-d72d7e7730f8-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-bf8d1fec-adbd-4899-b580-d72d7e7730f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "cinder-quobyte-bf8d1fec-adbd-4899-b580-d72d7e7730f8" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-bf8d1fec-adbd-4899-b580-d72d7e7730f8" acquired by "delete_volume" :: waited 0.035s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fb517e-025b-49c2-84c7-57913711725c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:56 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 Sep 11 14:07:56 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:56 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd 1G" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:56 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd Sep 11 14:07:56 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:56 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8" returned: 0 in 0.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:56 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8 Sep 11 14:07:56 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:56 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:56 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd is being set with open permissions: ugo+rw Sep 11 14:07:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:56 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd Sep 11 14:07:56 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:57 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bf8d1fec-adbd-4899-b580-d72d7e7730f8" returned: 0 in 0.318s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-quobyte-bf8d1fec-adbd-4899-b580-d72d7e7730f8" released by "delete_volume" :: held 0.796s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:57 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd" returned: 0 in 0.282s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Created reservations ['78e7cdc5-fa1d-4457-83e4-db21eaf3ea9a', 'c6f0bb03-fe65-41ec-b1f3-e154827c7d05', 'b4dafc12-d719-47cc-85f3-c0b28887d9af', '18fec01d-431b-4924-8f06-04075f866046'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:07:57 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info Sep 11 14:07:57 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:57 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:07:57 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:57 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info" returned: 0 in 0.308s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:57 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info is being set with open permissions: ugo+rw Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:57 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info Sep 11 14:07:57 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:57 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:07:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Deleted volume successfully. Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a34a68fb-ed80-43d9-be24-5a3921b93511 tempest-CreateVolumesFromSnapshotTest-865286340 None] Lock "cinder-bf8d1fec-adbd-4899-b580-d72d7e7730f8-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:07:57 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.info" returned: 0 in 0.309s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:07:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2022214429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e332dd09-1816-4dab-948a-3c80e97f957d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc63e85038cc4601b67c6b33e16291d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:07:56Z,use_quota=True,user_id='54fe95fa41434844b63be03615833cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Creating volume e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:07:57 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:07:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:57 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d 1073741824 Sep 11 14:07:57 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:57 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2b7bdc16-e9bb-44f7-81bd-53f47b4c7239 tempest-ProjectReaderTests-840254707 None] Create snapshot completed successfully Sep 11 14:07:58 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d 1073741824" returned: 0 in 0.538s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:58 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d Sep 11 14:07:58 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-8241802e-2db8-4528-bea2-017e62f818dd-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-8241802e-2db8-4528-bea2-017e62f818dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-c7e3cebb-6b85-44b5-b506-364cc7974d99" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-c7e3cebb-6b85-44b5-b506-364cc7974d99" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-8241802e-2db8-4528-bea2-017e62f818dd" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-8241802e-2db8-4528-bea2-017e62f818dd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Deleting offline snapshot 8241802e-2db8-4528-bea2-017e62f818dd of volume c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] snapshot_file for this snap is: volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b530921-da08-4c97-8222-2b37c4059a3a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:58 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d" returned: 0 in 0.341s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614a344b-2a44-4219-860b-f41b202f251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e332dd09-1816-4dab-948a-3c80e97f957d', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29342535-e4a9-45b0-9c7a-7def2e8b0bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:07:58 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Volume volume-e332dd09-1816-4dab-948a-3c80e97f957d (e332dd09-1816-4dab-948a-3c80e97f957d): created successfully Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29342535-e4a9-45b0-9c7a-7def2e8b0bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:07:58 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Flow 'volume_create_manager' (44975649-d906-4e71-beb1-ef0627de3ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:07:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e57b9010-9bab-4666-81ed-d2e1da8a4342 tempest-CinderUnicodeTest-1856542836 None] Created volume successfully. Sep 11 14:07:58 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd Sep 11 14:07:58 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:59 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd" returned: 0 in 0.474s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e3cebb-6b85-44b5-b506-364cc7974d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99bf8cf-dfec-4fdf-8ca0-718a25ab0578]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:59 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 Sep 11 14:07:59 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Creating offline snapshot 1c76d67a-bcf1-4fd4-907e-4f39d8a933cf of volume e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb470b77-4588-46b6-8441-2adb4011f100]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:59 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99" returned: 0 in 0.548s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:07:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:07:59 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd Sep 11 14:07:59 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:07:59 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d Sep 11 14:07:59 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:00 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d" returned: 0 in 0.467s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:00 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf 1G Sep 11 14:08:00 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:00 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd" returned: 0 in 0.454s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:00 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd Sep 11 14:08:00 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:00 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99.8241802e-2db8-4528-bea2-017e62f818dd" returned: 0 in 0.322s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-8241802e-2db8-4528-bea2-017e62f818dd" released by "_delete_snapshot" :: held 1.946s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-c7e3cebb-6b85-44b5-b506-364cc7974d99" released by "delete_snapshot" :: held 1.981s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Created reservations ['bc1cc152-cc00-4322-8275-2c22d7895535', '2e36580b-c01e-478f-9d1f-0e2a40072691', '7b2b14b8-f02e-4d0e-8e24-d46ac42b8de2', 'dcaedd4c-1940-443e-bd04-853fad9c5c4f'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:00 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf 1G" returned: 0 in 0.594s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e332dd09-1816-4dab-948a-3c80e97f957d -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Delete snapshot completed successfully. Sep 11 14:08:00 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e332dd09-1816-4dab-948a-3c80e97f957d -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf Sep 11 14:08:00 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6ebd58f8-62e5-46f1-93d7-326c865f7db8 tempest-ProjectReaderTests-840254707 None] Lock "cinder-8241802e-2db8-4528-bea2-017e62f818dd-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:01 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e332dd09-1816-4dab-948a-3c80e97f957d -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:01 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf is being set with open permissions: ugo+rw Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:01 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf Sep 11 14:08:01 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:01 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" returned: 0 in 0.261s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:01 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info Sep 11 14:08:01 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:01 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info" returned: 0 in 0.324s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:01 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info is being set with open permissions: ugo+rw Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:01 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info Sep 11 14:08:01 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-c7e3cebb-6b85-44b5-b506-364cc7974d99-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Lock "cinder-c7e3cebb-6b85-44b5-b506-364cc7974d99-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-c7e3cebb-6b85-44b5-b506-364cc7974d99" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-c7e3cebb-6b85-44b5-b506-364cc7974d99" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d9ac3-6fe5-48c1-871d-c1fa11ab7c60]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:02 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.info" returned: 0 in 0.413s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a598b69d-54c3-478e-a892-e5920dc2ac5d tempest-CinderUnicodeTest-1856542836 None] Create snapshot completed successfully Sep 11 14:08:02 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 Sep 11 14:08:02 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:02 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99" returned: 0 in 0.466s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:02 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99 Sep 11 14:08:02 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:02 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7e3cebb-6b85-44b5-b506-364cc7974d99" returned: 0 in 0.307s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-c7e3cebb-6b85-44b5-b506-364cc7974d99" released by "delete_volume" :: held 0.859s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-1c76d67a-bcf1-4fd4-907e-4f39d8a933cf-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-1c76d67a-bcf1-4fd4-907e-4f39d8a933cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-quobyte-e332dd09-1816-4dab-948a-3c80e97f957d" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-e332dd09-1816-4dab-948a-3c80e97f957d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-quobyte-1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Deleting offline snapshot 1c76d67a-bcf1-4fd4-907e-4f39d8a933cf of volume e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] snapshot_file for this snap is: volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb278f-099c-458e-ba88-b5364a77a39e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Created reservations ['44bc6f70-b790-4fa2-8b20-ff0bee2db913', '9e0a9349-e0a1-4460-950d-7f7c941ea416', 'd9ab91be-9748-44f8-8208-67285b55de1f', 'bd285ecc-e42d-4889-95bc-a13ac699b141'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:UPDATE=299,cinder:SELECT=218,cinder:DELETE=31,cinder:INSERT=80 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:03 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf Sep 11 14:08:03 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:03 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:03 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:03 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.343s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:03 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Deleted volume successfully. Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=213,cinder:UPDATE=304,cinder:INSERT=73,cinder:DELETE=24 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b41a62ad-e535-4ae1-9de5-f4e01bcc9268 tempest-ProjectReaderTests-840254707 None] Lock "cinder-c7e3cebb-6b85-44b5-b506-364cc7974d99-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:03 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" returned: 0 in 0.687s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e332dd09-1816-4dab-948a-3c80e97f957d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801ef93-a6b6-4cb1-8eee-689f1334e883]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:03 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d Sep 11 14:08:03 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:04 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d" returned: 0 in 0.578s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:04 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf Sep 11 14:08:04 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Flow 'volume_create_manager' (c49d0d02-5ff1-4705-8e7b-b547d6c8705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dac8ec-d019-4b56-b5d1-f17038f14c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dac8ec-d019-4b56-b5d1-f17038f14c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abec9de3-0032-4236-a878-22afaec1e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9279a6e744488797d4b896c5ab1b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:05Z,use_quota=True,user_id='5d56005ed644414993fe9c40be2494de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30995d52-1f02-4e51-998e-43efa83bcaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30995d52-1f02-4e51-998e-43efa83bcaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0510fb96-6bbe-4530-bec0-f2adc0acd81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG cinder.image.glance [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Creating Keystone auth plugin from conf {{(pid=88731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 14:08:04 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" returned: 0 in 0.530s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:05 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf Sep 11 14:08:05 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0510fb96-6bbe-4530-bec0-f2adc0acd81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abec9de3-0032-4236-a878-22afaec1e0f5', 'volume_name': 'volume-abec9de3-0032-4236-a878-22afaec1e0f5', 'volume_size': 1, 'image_id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46794bad0c092c35d06064bbe2130056', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a9279a6e744488797d4b896c5ab1b81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae49a864c19b1c119bbb5c0e7b13b202dc43214f5a65829581eabbab15ff0685967a95a24f957a767f9b4ca08e7e310e949764f103966ef24a72ac596bf327bc', 'id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'created_at': datetime.datetime(2026, 9, 11, 12, 8, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 8, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42/file', 'properties': {}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959d2013-d571-45f7-9571-8d557465ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959d2013-d571-45f7-9571-8d557465ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a90481-93e0-4558-8e4f-3572ce7c3ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Volume abec9de3-0032-4236-a878-22afaec1e0f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abec9de3-0032-4236-a878-22afaec1e0f5', 'volume_size': 1, 'image_id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46794bad0c092c35d06064bbe2130056', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a9279a6e744488797d4b896c5ab1b81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae49a864c19b1c119bbb5c0e7b13b202dc43214f5a65829581eabbab15ff0685967a95a24f957a767f9b4ca08e7e310e949764f103966ef24a72ac596bf327bc', 'id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'created_at': datetime.datetime(2026, 9, 11, 12, 8, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 8, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42/file', 'properties': {}}, 'image_service': } Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Trying to clone abec9de3-0032-4236-a878-22afaec1e0f5 from image d78ed7ea-b244-4379-9e73-8cbc5100cf42 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42', 'metadata': {}}]). {{(pid=88731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (8388fca6-c69a-466e-9c55-0d12fae43902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e9abd6-acfb-46d2-9630-77ce3e276661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e9abd6-acfb-46d2-9630-77ce3e276661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511851559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4d224-d7d0-4cd9-99dd-164378985fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:05Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0d4683-b36b-4cf9-b746-cdb9b1fd8403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0d4683-b36b-4cf9-b746-cdb9b1fd8403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e91c143-90b4-40ea-82f8-020aff4dad71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e91c143-90b4-40ea-82f8-020aff4dad71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d4d224-d7d0-4cd9-99dd-164378985fd9', 'volume_name': 'volume-94d4d224-d7d0-4cd9-99dd-164378985fd9', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2339b5f-6e9e-459a-9d05-39e31ad40fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2339b5f-6e9e-459a-9d05-39e31ad40fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f473b7a3-074b-473f-8ffa-de86b96d315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:05 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Volume 94d4d224-d7d0-4cd9-99dd-164378985fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d4d224-d7d0-4cd9-99dd-164378985fd9', 'volume_size': 1} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511851559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d4d224-d7d0-4cd9-99dd-164378985fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:05Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Creating volume 94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:05 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 11 14:08:05 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Image download 0.00 MB at 0.00 MB/s Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d.1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" returned: 0 in 0.516s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:05 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 1073741824 Sep 11 14:08:05 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-1c76d67a-bcf1-4fd4-907e-4f39d8a933cf" released by "_delete_snapshot" :: held 2.471s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-e332dd09-1816-4dab-948a-3c80e97f957d" released by "delete_snapshot" :: held 2.516s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d78ec9a-65f1-4ccb-98d9-19a44428c8d1]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Created reservations ['3cf04311-d991-42ae-9162-2af62bee6985', '43ff0c96-6bde-483c-9a9b-7aae696d1158', '94afea0d-143e-45e3-8288-86f40711066d', 'cb93aa48-7a46-4ee7-8786-f22ea63796bc'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:05 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD Sep 11 14:08:05 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Delete snapshot completed successfully. Sep 11 14:08:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cbc6dd0e-7e4d-4475-988b-2815955b657b tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-1c76d67a-bcf1-4fd4-907e-4f39d8a933cf-delete_snapshot" released by "delete_snapshot" :: held 2.773s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:06 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:06 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 1073741824" returned: 0 in 0.670s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:06 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD Sep 11 14:08:06 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:06 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 Sep 11 14:08:06 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-e332dd09-1816-4dab-948a-3c80e97f957d-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-e332dd09-1816-4dab-948a-3c80e97f957d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-quobyte-e332dd09-1816-4dab-948a-3c80e97f957d" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-e332dd09-1816-4dab-948a-3c80e97f957d" acquired by "delete_volume" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:06 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:06 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9" returned: 0 in 0.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD" returned: 1 in 0.611s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Temporary image d78ed7ea-b244-4379-9e73-8cbc5100cf42 is fetched for user 5d56005ed644414993fe9c40be2494de. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d84f61-0c00-49e3-bbbe-08dd28132cbd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f473b7a3-074b-473f-8ffa-de86b96d315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d4d224-d7d0-4cd9-99dd-164378985fd9', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e88893-fbcc-4db9-94ba-953b40e5bd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Volume volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 (94d4d224-d7d0-4cd9-99dd-164378985fd9): created successfully Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e88893-fbcc-4db9-94ba-953b40e5bd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (8388fca6-c69a-466e-9c55-0d12fae43902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:06 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ac5129a3-ac51-4fa1-83e6-72e3c3a3a512 tempest-ProjectReaderTests-840254707 None] Created volume successfully. Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ae4dd4-e621-4584-abc0-5209615e3d09]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:06 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d Sep 11 14:08:06 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:06 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD Sep 11 14:08:06 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:07 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:07 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d" returned: 0 in 0.522s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:07 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d Sep 11 14:08:07 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:07 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD Sep 11 14:08:07 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Creating offline snapshot b2b79472-3035-48e2-85ad-e7cf78920c3f of volume 94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[508604b6-dd45-48a4-adf2-8758a5d5cca3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:07 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-e332dd09-1816-4dab-948a-3c80e97f957d" returned: 0 in 0.316s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-e332dd09-1816-4dab-948a-3c80e97f957d" released by "delete_volume" :: held 0.951s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:07 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Created reservations ['665ae549-4db8-4145-8a3f-47feb66da9f4', '70022923-84d8-4adf-98b1-5c928d734a1b', '0f3b4ddd-7fff-465b-83a4-48ed3b30222c', '84fe7f54-57f1-4a9e-bccd-e26e0f35022b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:07 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 Sep 11 14:08:07 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:07 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:07 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Flow 'volume_create_manager' (5237584e-a716-4c62-81a6-f49eca243603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2805cb6-343f-4481-ac47-1542346393b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2805cb6-343f-4481-ac47-1542346393b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2062952710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637fe093-6b9d-4f1a-977c-9e3d1856ee31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f40cf510de48e48aa11950181791ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:08Z,use_quota=True,user_id='60cfcdbc695c400e99af7b60822add4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588de3dc-0a98-4380-8d2c-16af4895af83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588de3dc-0a98-4380-8d2c-16af4895af83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:07 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c699ebc-dcf1-4f67-b2d8-864fa86f6bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c699ebc-dcf1-4f67-b2d8-864fa86f6bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637fe093-6b9d-4f1a-977c-9e3d1856ee31', 'volume_name': 'volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a12012c-1586-4062-9a99-031c376144e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a12012c-1586-4062-9a99-031c376144e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c131f480-c7b7-4fc5-83cb-249ef841c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Volume 637fe093-6b9d-4f1a-977c-9e3d1856ee31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31', 'volume_size': 1} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9" returned: 0 in 0.449s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:07 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:07 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f 1G Sep 11 14:08:07 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Deleted volume successfully. Sep 11 14:08:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5add0bbe-973f-40f3-a360-93f01f61e6fd tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-e332dd09-1816-4dab-948a-3c80e97f957d-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:08 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f 1G" returned: 0 in 0.386s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:08 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f Sep 11 14:08:08 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:08 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:08 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f is being set with open permissions: ugo+rw Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:08 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f Sep 11 14:08:08 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-4c3930c0-cdad-45be-bf14-4e312d1dc6b6-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-4c3930c0-cdad-45be-bf14-4e312d1dc6b6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "cinder-quobyte-4c3930c0-cdad-45be-bf14-4e312d1dc6b6" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-4c3930c0-cdad-45be-bf14-4e312d1dc6b6" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:08 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d1e22c-6966-4c92-9746-2090a889df91]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:08 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info Sep 11 14:08:08 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:08 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 Sep 11 14:08:08 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:09 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:09 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info is being set with open permissions: ugo+rw Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:09 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info Sep 11 14:08:09 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:09 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:09 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6 Sep 11 14:08:09 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:09 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.info" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abec9de3-0032-4236-a878-22afaec1e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9279a6e744488797d4b896c5ab1b81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:05Z,use_quota=True,user_id='5d56005ed644414993fe9c40be2494de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Creating volume abec9de3-0032-4236-a878-22afaec1e0f5 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:09 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:09 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 1073741824 Sep 11 14:08:09 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b68d8185-5ebb-4b96-bb35-99309a556961 tempest-ProjectReaderTests-840254707 None] Create snapshot completed successfully Sep 11 14:08:09 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-4c3930c0-cdad-45be-bf14-4e312d1dc6b6" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-quobyte-4c3930c0-cdad-45be-bf14-4e312d1dc6b6" released by "delete_volume" :: held 0.685s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Created reservations ['f40e4bb8-a3e4-4315-8e78-7935afd06849', '59dc579f-b12e-445a-bf6e-159d9e4c6d64', '86ea99c6-b521-4c44-b0d1-c6bce3849381', 'f0a6d143-df2a-4ea6-85a8-15ac5619fd62'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:09 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:09 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:09 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 1073741824" returned: 0 in 0.445s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:09 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 Sep 11 14:08:09 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:09 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.300s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Deleted volume successfully. Sep 11 14:08:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-353b5500-6fcb-4f23-8b26-39d85e14cfdf tempest-CinderUnicodeTest-1856542836 None] Lock "cinder-4c3930c0-cdad-45be-bf14-4e312d1dc6b6-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:10 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5" returned: 0 in 0.259s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2062952710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637fe093-6b9d-4f1a-977c-9e3d1856ee31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f40cf510de48e48aa11950181791ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:08Z,use_quota=True,user_id='60cfcdbc695c400e99af7b60822add4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Creating volume 637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:10 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:10 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 1073741824 Sep 11 14:08:10 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Attempting download of d78ed7ea-b244-4379-9e73-8cbc5100cf42 ((None, [{'url': 'file:///opt/stack/data/glance/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42', 'metadata': {}}])) to volume abec9de3-0032-4236-a878-22afaec1e0f5. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583bbe5-beaa-4d53-a155-082122873a8f]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:10 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja Sep 11 14:08:10 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-b2b79472-3035-48e2-85ad-e7cf78920c3f-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Lock "cinder-b2b79472-3035-48e2-85ad-e7cf78920c3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-94d4d224-d7d0-4cd9-99dd-164378985fd9" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:10 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:10 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-94d4d224-d7d0-4cd9-99dd-164378985fd9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-b2b79472-3035-48e2-85ad-e7cf78920c3f" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:10 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja" returned: 0 in 0.434s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-b2b79472-3035-48e2-85ad-e7cf78920c3f" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Deleting offline snapshot b2b79472-3035-48e2-85ad-e7cf78920c3f of volume 94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] snapshot_file for this snap is: volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:10 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 1073741824" returned: 0 in 0.601s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5bd7a-97f7-4fc0-bc60-031a3a133bda]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:10 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja Sep 11 14:08:10 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:10 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 Sep 11 14:08:10 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:10 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f Sep 11 14:08:10 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:11 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.519s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:08:11 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja" returned: 1 in 0.493s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d78ed7ea-b244-4379-9e73-8cbc5100cf42_ut4pmgja' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6174b488-cde6-48f8-afd6-78b420717c48]: (4, 'raw') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:11 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31" returned: 0 in 0.377s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c131f480-c7b7-4fc5-83cb-249ef841c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3670df-aeb6-449a-9116-a19bda333110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:11 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Volume volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 (637fe093-6b9d-4f1a-977c-9e3d1856ee31): created successfully Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3670df-aeb6-449a-9116-a19bda333110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:11 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Flow 'volume_create_manager' (5237584e-a716-4c62-81a6-f49eca243603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f" returned: 0 in 0.502s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94d4d224-d7d0-4cd9-99dd-164378985fd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c10309b-c7f5-42dc-83e7-024ad0fbb813]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:11 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD Sep 11 14:08:11 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:11 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-30ae6f16-8bad-4d06-80b3-874899024d44 tempest-SnapshotDependencyTests-515647043 None] Created volume successfully. Sep 11 14:08:11 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 Sep 11 14:08:11 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:11 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:11 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD Sep 11 14:08:11 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9" returned: 0 in 0.420s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:11 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f Sep 11 14:08:11 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:11 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] d78ed7ea-b244-4379-9e73-8cbc5100cf42 was raw, converting to qcow2 {{(pid=88731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 11 14:08:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:11 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 Sep 11 14:08:11 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:12 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f" returned: 0 in 0.429s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:12 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f Sep 11 14:08:12 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Creating offline snapshot 93b53e8c-8c99-435f-9bf1-e5355ee21b9b of volume 637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338faf2-fa57-405f-a9fb-d90f25f92532]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:12 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9.b2b79472-3035-48e2-85ad-e7cf78920c3f" returned: 0 in 0.341s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-b2b79472-3035-48e2-85ad-e7cf78920c3f" released by "_delete_snapshot" :: held 1.816s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-94d4d224-d7d0-4cd9-99dd-164378985fd9" released by "delete_snapshot" :: held 1.874s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:12 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 Sep 11 14:08:12 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Created reservations ['ed8c3af2-5f30-409c-845d-12a04c693266', '91b870f2-abd9-48b4-b992-97f6a8f54d93', '73a07954-f7fe-4929-a604-80a5ec97151a', 'a9832348-2f83-4e5c-9a5c-dece6e9a0697'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:12 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5" returned: 0 in 0.707s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d78ed7ea-b244-4379-9e73-8cbc5100cf42_lyx26gmldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:08:12 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:12 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 1G Sep 11 14:08:12 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Delete snapshot completed successfully. Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-2a66ece9-302b-4295-b080-ab622ee19913 tempest-ProjectReaderTests-840254707 None] Lock "cinder-b2b79472-3035-48e2-85ad-e7cf78920c3f-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-94d4d224-d7d0-4cd9-99dd-164378985fd9-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Lock "cinder-94d4d224-d7d0-4cd9-99dd-164378985fd9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-94d4d224-d7d0-4cd9-99dd-164378985fd9" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-94d4d224-d7d0-4cd9-99dd-164378985fd9" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:12 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31" returned: 0 in 0.521s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbffa337-4ba8-4705-8d93-9bc4ffc7751c]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:12 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b 1G Sep 11 14:08:12 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:13 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 1G" returned: 0 in 0.388s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Downloaded image d78ed7ea-b244-4379-9e73-8cbc5100cf42 ((None, [{'url': 'file:///opt/stack/data/glance/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42', 'metadata': {}}])) to volume abec9de3-0032-4236-a878-22afaec1e0f5 successfully. {{(pid=88731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Temporary image d78ed7ea-b244-4379-9e73-8cbc5100cf42 for user 5d56005ed644414993fe9c40be2494de is deleted. {{(pid=88731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.volume_utils [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Marking volume abec9de3-0032-4236-a878-22afaec1e0f5 as bootable. {{(pid=88731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Copying metadata from image d78ed7ea-b244-4379-9e73-8cbc5100cf42 to abec9de3-0032-4236-a878-22afaec1e0f5. {{(pid=88731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Creating volume glance metadata for volume abec9de3-0032-4236-a878-22afaec1e0f5 backed by image d78ed7ea-b244-4379-9e73-8cbc5100cf42 with: {'image_id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '46794bad0c092c35d06064bbe2130056', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a90481-93e0-4558-8e4f-3572ce7c3ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abec9de3-0032-4236-a878-22afaec1e0f5', 'volume_size': 1, 'image_id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46794bad0c092c35d06064bbe2130056', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a9279a6e744488797d4b896c5ab1b81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae49a864c19b1c119bbb5c0e7b13b202dc43214f5a65829581eabbab15ff0685967a95a24f957a767f9b4ca08e7e310e949764f103966ef24a72ac596bf327bc', 'id': 'd78ed7ea-b244-4379-9e73-8cbc5100cf42', 'created_at': datetime.datetime(2026, 9, 11, 12, 8, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 12, 8, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d78ed7ea-b244-4379-9e73-8cbc5100cf42/file', 'properties': {}}, 'image_service': }' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:13 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddd2727-f2ea-4860-8343-31e1dd35d6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:13 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:13 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Volume volume-abec9de3-0032-4236-a878-22afaec1e0f5 (abec9de3-0032-4236-a878-22afaec1e0f5): created successfully Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddd2727-f2ea-4860-8343-31e1dd35d6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Flow 'volume_create_manager' (c49d0d02-5ff1-4705-8e7b-b547d6c8705f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5549bcde-7399-48ad-aa12-e90d05d8eeb0 tempest-VolumeImageDependencyTests-1009956091 None] Created volume successfully. Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Acquiring lock "cinder-abec9de3-0032-4236-a878-22afaec1e0f5-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:13 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9" returned: 0 in 0.512s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:13 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Lock "cinder-abec9de3-0032-4236-a878-22afaec1e0f5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b 1G" returned: 0 in 0.565s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:13 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9 Sep 11 14:08:13 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:13 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b Sep 11 14:08:13 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Acquiring lock "cinder-quobyte-abec9de3-0032-4236-a878-22afaec1e0f5" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Lock "cinder-quobyte-abec9de3-0032-4236-a878-22afaec1e0f5" acquired by "delete_volume" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa6c5e0-7b3c-4f2a-90fc-15767bf5cac1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:13 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 Sep 11 14:08:13 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:13 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-94d4d224-d7d0-4cd9-99dd-164378985fd9" returned: 0 in 0.311s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-94d4d224-d7d0-4cd9-99dd-164378985fd9" released by "delete_volume" :: held 0.921s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:13 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b" returned: 0 in 0.347s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:13 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b is being set with open permissions: ugo+rw Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Created reservations ['0a813a7f-7bbc-4363-b344-f3d19cf9f509', '957dabcf-8812-43a6-9494-a02780aa3c0b', '797c6474-8706-4135-bd28-09bb66c87845', 'ee4ffc1a-b6cc-4778-a16a-f0014e19f435'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:13 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b Sep 11 14:08:13 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:14 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:14 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:14 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5" returned: 0 in 0.558s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:14 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:14 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5 Sep 11 14:08:14 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:14 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:14 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info Sep 11 14:08:14 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Deleted volume successfully. Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-da797aec-fe26-4846-8aa1-d4bdfc3743bf tempest-ProjectReaderTests-840254707 None] Lock "cinder-94d4d224-d7d0-4cd9-99dd-164378985fd9-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:14 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-abec9de3-0032-4236-a878-22afaec1e0f5" returned: 0 in 0.332s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Lock "cinder-quobyte-abec9de3-0032-4236-a878-22afaec1e0f5" released by "delete_volume" :: held 0.934s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (35a06bf9-4167-4746-bcc5-eeb3dffca171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff185d2-12c6-4448-97fb-9bc5150f884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff185d2-12c6-4448-97fb-9bc5150f884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835631436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a0a89b-85ac-4369-b224-d9b6d9f15143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:14Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8f0d67-1f8f-4d88-ab7b-cdedde570b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8f0d67-1f8f-4d88-ab7b-cdedde570b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2dc7ba-d51f-478e-8627-0f086544162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2dc7ba-d51f-478e-8627-0f086544162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a0a89b-85ac-4369-b224-d9b6d9f15143', 'volume_name': 'volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cc561b-db5c-4cef-b979-a61c0a9034b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cc561b-db5c-4cef-b979-a61c0a9034b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b74ebd-0c14-49f8-9177-2ee711cfcb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Volume a2a0a89b-85ac-4369-b224-d9b6d9f15143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143', 'volume_size': 1} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:14 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info" returned: 0 in 0.348s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:14 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info is being set with open permissions: ugo+rw Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:14 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info Sep 11 14:08:14 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Created reservations ['de35412b-116c-4c0d-b680-b950414a320a', 'd532abba-e261-4411-a8ff-e6c728cffa7a', '5e484714-69f8-4377-b271-f8d71bf15e0b', 'b46b1133-a2a0-4cd6-bc20-d0b6db38a499'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (7781f046-d4f5-4dce-b588-24fe5969491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133034dd-268a-4a9a-af35-a1dd934736fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133034dd-268a-4a9a-af35-a1dd934736fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-902765820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1d83f8-b095-49b0-a213-e2c43e59ee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:15Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd699f2-31af-43e9-8c89-4e46bb57f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd699f2-31af-43e9-8c89-4e46bb57f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e6cbb0-9c75-46b4-963d-54478433b0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e6cbb0-9c75-46b4-963d-54478433b0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1d83f8-b095-49b0-a213-e2c43e59ee25', 'volume_name': 'volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f8889d-b89c-4578-8358-9a77387c7312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f8889d-b89c-4578-8358-9a77387c7312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb604150-c166-46aa-910d-54de45bf6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Volume ae1d83f8-b095-49b0-a213-e2c43e59ee25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25', 'volume_size': 1} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:14 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:14 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:14 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.info" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835631436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a0a89b-85ac-4369-b224-d9b6d9f15143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:14Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Creating volume a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:14 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:14 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 1073741824 Sep 11 14:08:14 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8faeb7d4-0908-4fc3-b233-702f2d28fa8f tempest-SnapshotDependencyTests-515647043 None] Create snapshot completed successfully Sep 11 14:08:15 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Deleted volume successfully. Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-68d045bb-a88d-4bbd-9652-53e0e7b091c7 tempest-VolumeImageDependencyTests-1009956091 None] Lock "cinder-abec9de3-0032-4236-a878-22afaec1e0f5-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:15 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 1073741824" returned: 0 in 0.416s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:15 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 Sep 11 14:08:15 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:15 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-902765820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1d83f8-b095-49b0-a213-e2c43e59ee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:15Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Creating volume ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:15 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b74ebd-0c14-49f8-9177-2ee711cfcb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73c0ecc-33c6-4d0c-a989-71e2baece0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:15 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 1073741824 Sep 11 14:08:15 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:15 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Volume volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 (a2a0a89b-85ac-4369-b224-d9b6d9f15143): created successfully Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f73c0ecc-33c6-4d0c-a989-71e2baece0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:15 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (35a06bf9-4167-4746-bcc5-eeb3dffca171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f5c64208-6ea9-4a96-b679-52fbe82e68b4 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:08:16 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 1073741824" returned: 0 in 0.546s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:16 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 Sep 11 14:08:16 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Flow 'volume_create_manager' (db043ffe-d0cd-49f1-9a12-ba020475da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a164c1-9c94-4808-aa26-56c49ea41a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a164c1-9c94-4808-aa26-56c49ea41a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff2a869-19a3-4d72-bea5-0091db13bb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f40cf510de48e48aa11950181791ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93b53e8c-8c99-435f-9bf1-e5355ee21b9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:16Z,use_quota=True,user_id='60cfcdbc695c400e99af7b60822add4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00426204-12f2-4a7c-be9b-2b975f67e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00426204-12f2-4a7c-be9b-2b975f67e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe05b6b-6ff4-4941-8cfc-386e4b4d50f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe05b6b-6ff4-4941-8cfc-386e4b4d50f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aff2a869-19a3-4d72-bea5-0091db13bb0c', 'volume_name': 'volume-aff2a869-19a3-4d72-bea5-0091db13bb0c', 'volume_size': 1, 'snapshot_id': '93b53e8c-8c99-435f-9bf1-e5355ee21b9b'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b45682-2287-472b-b159-d5775ba87bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b45682-2287-472b-b159-d5775ba87bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6002fa1-8ed9-46da-94d2-388318258245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:16 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Volume aff2a869-19a3-4d72-bea5-0091db13bb0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aff2a869-19a3-4d72-bea5-0091db13bb0c', 'volume_size': 1, 'snapshot_id': '93b53e8c-8c99-435f-9bf1-e5355ee21b9b'} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:16 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25" returned: 0 in 0.313s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.159s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-quobyte-93b53e8c-8c99-435f-9bf1-e5355ee21b9b-aff2a869-19a3-4d72-bea5-0091db13bb0c" by "_create_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb604150-c166-46aa-910d-54de45bf6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e67dfc4-b18a-48c0-8fde-ae68a319e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-93b53e8c-8c99-435f-9bf1-e5355ee21b9b-aff2a869-19a3-4d72-bea5-0091db13bb0c" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Creating volume aff2a869-19a3-4d72-bea5-0091db13bb0c from snapshot 93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-quobyte-aff2a869-19a3-4d72-bea5-0091db13bb0c" by "_copy_volume_from_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-aff2a869-19a3-4d72-bea5-0091db13bb0c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] snapshot: 93b53e8c-8c99-435f-9bf1-e5355ee21b9b, volume: aff2a869-19a3-4d72-bea5-0091db13bb0c, {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 14:08:16 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Volume volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 (ae1d83f8-b095-49b0-a213-e2c43e59ee25): created successfully Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e67dfc4-b18a-48c0-8fde-ae68a319e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (7781f046-d4f5-4dce-b588-24fe5969491f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c6a11407-ac44-4f1a-bc32-3284e684a031 tempest-ProjectReaderTests-840254707 None] Created volume successfully. Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df2979f-f9e4-4294-a20c-8f65cba467df]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:16 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b Sep 11 14:08:16 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:17 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b" returned: 0 in 0.433s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[641f5986-5db7-4785-bbe4-e72a9c8e3309]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:17 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 Sep 11 14:08:17 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:17 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31" returned: 0 in 0.425s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Creating direct copy from snapshot {{(pid=88731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG cinder.utils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Path /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c not found in is_blk_device check {{(pid=88731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 14:08:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:17 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c Sep 11 14:08:17 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:22 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c" returned: 0 in 4.955s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.image.image_utils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Image conversion details: src /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c {{(pid=88731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 11 14:08:22 devstack cinder-volume[88731]: INFO cinder.image.image_utils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Converted 1024.00 MB image at 206.61 MB/s Sep 11 14:08:22 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c is being set with open permissions: ugo+rw Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:22 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c Sep 11 14:08:22 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:22 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-aff2a869-19a3-4d72-bea5-0091db13bb0c" released by "_copy_volume_from_snapshot" :: held 6.184s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-93b53e8c-8c99-435f-9bf1-e5355ee21b9b-aff2a869-19a3-4d72-bea5-0091db13bb0c" released by "_create_volume_from_snapshot" :: held 6.256s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.314s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.974s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 of volume a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6002fa1-8ed9-46da-94d2-388318258245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff2a869-19a3-4d72-bea5-0091db13bb0c', 'volume_size': 1, 'snapshot_id': '93b53e8c-8c99-435f-9bf1-e5355ee21b9b'}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380b900e-44b5-42e0-a2cf-60ce294c6a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218d886-58b0-4745-8466-9c883dc78b9e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:22 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Volume volume-aff2a869-19a3-4d72-bea5-0091db13bb0c (aff2a869-19a3-4d72-bea5-0091db13bb0c): created successfully Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380b900e-44b5-42e0-a2cf-60ce294c6a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:22 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Flow 'volume_create_manager' (db043ffe-d0cd-49f1-9a12-ba020475da84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:23 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d55fdea8-2dc5-45e1-b3e7-09b1660e9cd5 tempest-SnapshotDependencyTests-515647043 None] Created volume successfully. Sep 11 14:08:23 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 Sep 11 14:08:23 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:23 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:23 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 1G Sep 11 14:08:23 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:23 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 1G" returned: 0 in 0.462s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:23 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 Sep 11 14:08:23 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:24 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:24 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 is being set with open permissions: ugo+rw Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:24 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 Sep 11 14:08:24 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-93b53e8c-8c99-435f-9bf1-e5355ee21b9b-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-93b53e8c-8c99-435f-9bf1-e5355ee21b9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-quobyte-637fe093-6b9d-4f1a-977c-9e3d1856ee31" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-637fe093-6b9d-4f1a-977c-9e3d1856ee31" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-quobyte-93b53e8c-8c99-435f-9bf1-e5355ee21b9b" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-93b53e8c-8c99-435f-9bf1-e5355ee21b9b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Deleting offline snapshot 93b53e8c-8c99-435f-9bf1-e5355ee21b9b of volume 637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] snapshot_file for this snap is: volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23618df-5e4a-444f-a60f-70fc4d267d2d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:24 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b Sep 11 14:08:24 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:24 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" returned: 0 in 0.293s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:24 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info Sep 11 14:08:24 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:24 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b" returned: 0 in 0.392s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[edede8c7-8eec-4598-ba79-fc59d540e264]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:24 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info" returned: 0 in 0.284s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:24 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info is being set with open permissions: ugo+rw Sep 11 14:08:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:24 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info Sep 11 14:08:24 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:24 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 Sep 11 14:08:24 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:25 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.info" returned: 0 in 0.258s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.037s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Creating offline snapshot 4b01b448-a677-481e-95cf-fed07cf50b21 of volume ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6a5ca-b7ad-48e7-ae71-803c60298d4f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d9d279db-16d3-4723-b4d2-5319277b5c73 tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:08:25 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 Sep 11 14:08:25 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:25 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31" returned: 0 in 0.609s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:25 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b Sep 11 14:08:25 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-f1fcf62e-6b6e-4643-b6e2-c770f46db2c0-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Lock "cinder-f1fcf62e-6b6e-4643-b6e2-c770f46db2c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-a2a0a89b-85ac-4369-b224-d9b6d9f15143" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-a2a0a89b-85ac-4369-b224-d9b6d9f15143" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 of volume a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55c650-95de-4fd3-b14a-80cdf0a8b387]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:25 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25" returned: 0 in 0.500s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:25 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 1G Sep 11 14:08:25 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:25 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 Sep 11 14:08:25 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:25 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b" returned: 0 in 0.568s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:25 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b Sep 11 14:08:25 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:26 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" returned: 0 in 0.502s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a5768e-fe3b-4b03-80ad-f0d612aac0dc]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:26 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 1G" returned: 0 in 0.612s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:26 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31.93b53e8c-8c99-435f-9bf1-e5355ee21b9b" returned: 0 in 0.328s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 Sep 11 14:08:26 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:26 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 Sep 11 14:08:26 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-93b53e8c-8c99-435f-9bf1-e5355ee21b9b" released by "_delete_snapshot" :: held 2.033s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-637fe093-6b9d-4f1a-977c-9e3d1856ee31" released by "delete_snapshot" :: held 2.058s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Created reservations ['c2c78ac6-5831-42ca-8b2e-511ed41bee5f', 'db5a3496-a05e-4c29-b8a7-59027705daf2', '7993afcd-8f9a-46ee-8060-ecef86a77856', 'ea8ce51f-d31b-429d-a7a4-8ae3c77e5543'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:26 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Delete snapshot completed successfully. Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-8fcb1791-4d8d-4013-a7a0-bff4984b55fb tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-93b53e8c-8c99-435f-9bf1-e5355ee21b9b-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:26 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143" returned: 0 in 0.483s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:26 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 is being set with open permissions: ugo+rw Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:26 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 Sep 11 14:08:26 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:26 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 Sep 11 14:08:26 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:26 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21" returned: 0 in 0.247s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:26 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" returned: 0 in 0.337s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:26 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info Sep 11 14:08:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:26 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:26 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0 Sep 11 14:08:26 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:27 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:27 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info is being set with open permissions: ugo+rw Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:27 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info Sep 11 14:08:27 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:27 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143.f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" returned: 0 in 0.291s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-f1fcf62e-6b6e-4643-b6e2-c770f46db2c0" released by "_delete_snapshot" :: held 1.755s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-a2a0a89b-85ac-4369-b224-d9b6d9f15143" released by "delete_snapshot" :: held 1.785s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Created reservations ['175e0dfc-a3a0-4fe4-a671-3d8d9fb8d9e8', 'e415ae6b-d128-406c-bc8e-4fd99e15bd37', '52a20b09-d2e1-4b82-a637-41f1851ba701', '81ca6d4a-f87b-4a46-ad1c-10fcc2f54270'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:27 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.info" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d48a5d75-4f70-40ae-bf0a-281aa424609d tempest-ProjectMemberTests-1521204887 None] Lock "cinder-f1fcf62e-6b6e-4643-b6e2-c770f46db2c0-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-637fe093-6b9d-4f1a-977c-9e3d1856ee31-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f0429c3f-2ead-4e61-b601-895b2ff109dc tempest-ProjectReaderTests-840254707 None] Create snapshot completed successfully Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-637fe093-6b9d-4f1a-977c-9e3d1856ee31-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-quobyte-637fe093-6b9d-4f1a-977c-9e3d1856ee31" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-637fe093-6b9d-4f1a-977c-9e3d1856ee31" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65463a4b-dd5d-4532-9e0f-b4bebc83a01f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-a2a0a89b-85ac-4369-b224-d9b6d9f15143-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-a2a0a89b-85ac-4369-b224-d9b6d9f15143-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-4b01b448-a677-481e-95cf-fed07cf50b21-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 Sep 11 14:08:27 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-a2a0a89b-85ac-4369-b224-d9b6d9f15143" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Lock "cinder-4b01b448-a677-481e-95cf-fed07cf50b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-ae1d83f8-b095-49b0-a213-e2c43e59ee25" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-ae1d83f8-b095-49b0-a213-e2c43e59ee25" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-4b01b448-a677-481e-95cf-fed07cf50b21" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-a2a0a89b-85ac-4369-b224-d9b6d9f15143" acquired by "delete_volume" :: waited 0.070s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-4b01b448-a677-481e-95cf-fed07cf50b21" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Deleting offline snapshot 4b01b448-a677-481e-95cf-fed07cf50b21 of volume ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] snapshot_file for this snap is: volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8070b-6c8a-4091-89c9-e9716009c619]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69be1904-7dbf-46bd-8d45-fff76cd1bcc7]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 Sep 11 14:08:28 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 Sep 11 14:08:28 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31" returned: 0 in 0.519s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31 Sep 11 14:08:28 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143" returned: 0 in 0.396s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143 Sep 11 14:08:28 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21" returned: 0 in 0.420s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:28 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-637fe093-6b9d-4f1a-977c-9e3d1856ee31" returned: 0 in 0.276s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf98125-7c27-4d06-b742-4ba6fb19ee75]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-637fe093-6b9d-4f1a-977c-9e3d1856ee31" released by "delete_volume" :: held 0.879s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Created reservations ['52eab70a-3e3f-4af2-b870-bac9891553ce', '4bee6da9-da70-4988-b3cc-e0223dbe4963', '2e4ae08d-e0b5-4203-b461-2994589880de', '5a820b2f-72b2-4612-98ac-99631144de29'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:28 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 Sep 11 14:08:28 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:28 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-a2a0a89b-85ac-4369-b224-d9b6d9f15143" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-a2a0a89b-85ac-4369-b224-d9b6d9f15143" released by "delete_volume" :: held 0.802s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-aff2a869-19a3-4d72-bea5-0091db13bb0c-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-aff2a869-19a3-4d72-bea5-0091db13bb0c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "cinder-quobyte-aff2a869-19a3-4d72-bea5-0091db13bb0c" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Created reservations ['1ff2c768-8cc0-441e-a749-9da142e7850c', '2150d9b8-7957-49f2-b0dd-1b0111bdda95', 'a113b691-acfa-4644-91d5-204c60db0e92', '61b4ee43-88d3-45fc-ac15-c5447d26107b'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-aff2a869-19a3-4d72-bea5-0091db13bb0c" acquired by "delete_volume" :: waited 0.028s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:28 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2abfde-e4a6-4a40-a44c-6f38f6545f73]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25" returned: 0 in 0.463s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 Sep 11 14:08:28 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:28 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:28 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Deleted volume successfully. Sep 11 14:08:29 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c Sep 11 14:08:29 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:29 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:29 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4f90f896-b73b-4eb4-886c-14f8d4c28f9c tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-637fe093-6b9d-4f1a-977c-9e3d1856ee31-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:29 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.402s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-104178f8-13c2-4116-ad95-b557a824d5f7 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-a2a0a89b-85ac-4369-b224-d9b6d9f15143-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:29 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c" returned: 0 in 0.580s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:29 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c Sep 11 14:08:29 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:29 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21" returned: 0 in 0.595s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:29 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21 Sep 11 14:08:29 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (03d6a7fe-f4a3-4394-ac3d-a42c6cb865ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a629925f-498d-4d77-9383-245d454870a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a629925f-498d-4d77-9383-245d454870a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103021534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5a1541-d8da-4290-a56c-d0194331e831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:30Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcce802-c77d-43d2-93d8-af66520c98e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcce802-c77d-43d2-93d8-af66520c98e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f8dd6d-4a02-4862-a5b9-a7de0d6c8ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f8dd6d-4a02-4862-a5b9-a7de0d6c8ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b5a1541-d8da-4290-a56c-d0194331e831', 'volume_name': 'volume-8b5a1541-d8da-4290-a56c-d0194331e831', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f56ced8-0ca1-43b8-95a3-b1f56cd4e487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f56ced8-0ca1-43b8-95a3-b1f56cd4e487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52bb5f6-4678-412a-8655-d59176e1fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:29 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Volume 8b5a1541-d8da-4290-a56c-d0194331e831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b5a1541-d8da-4290-a56c-d0194331e831', 'volume_size': 1} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103021534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b5a1541-d8da-4290-a56c-d0194331e831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:30Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Creating volume 8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:29 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:29 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-aff2a869-19a3-4d72-bea5-0091db13bb0c" returned: 0 in 0.306s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:29 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 1073741824 Sep 11 14:08:29 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-quobyte-aff2a869-19a3-4d72-bea5-0091db13bb0c" released by "delete_volume" :: held 0.957s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Created reservations ['51552987-c4c1-41c7-b96e-bc166374cd52', '42de53d9-c939-4e13-a913-c7a448d50653', '0d211969-f7bc-4dea-b9f5-7b3f55d64d21', '4168681f-5f03-46e8-a4a9-7b7c4cb41bdb'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:29 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25.4b01b448-a677-481e-95cf-fed07cf50b21" returned: 0 in 0.361s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-4b01b448-a677-481e-95cf-fed07cf50b21" released by "_delete_snapshot" :: held 1.990s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-ae1d83f8-b095-49b0-a213-e2c43e59ee25" released by "delete_snapshot" :: held 2.060s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:30 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:30 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Created reservations ['111a1669-3b4a-4306-85aa-b53ce5413914', '70407bf4-0853-45f2-9361-3d0ed2894d2e', '199ed7ff-9afc-4eed-941b-41632e1fbd4a', '09ba8b24-8ef8-4fdc-b9a7-0f5c76612eb3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Delete snapshot completed successfully. Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-09bdf329-0992-4a8e-b55f-eb3a77cdc5bc tempest-ProjectReaderTests-840254707 None] Lock "cinder-4b01b448-a677-481e-95cf-fed07cf50b21-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:30 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 1073741824" returned: 0 in 0.557s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:30 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.318s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Deleted volume successfully. Sep 11 14:08:30 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 Sep 11 14:08:30 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-26e2b6f9-a4f4-4d18-acb2-1efec3d7e858 tempest-SnapshotDependencyTests-515647043 None] Lock "cinder-aff2a869-19a3-4d72-bea5-0091db13bb0c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:30 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52bb5f6-4678-412a-8655-d59176e1fab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b5a1541-d8da-4290-a56c-d0194331e831', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484eb8f3-cee7-4522-9ab6-a62b20820a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:30 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Volume volume-8b5a1541-d8da-4290-a56c-d0194331e831 (8b5a1541-d8da-4290-a56c-d0194331e831): created successfully Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484eb8f3-cee7-4522-9ab6-a62b20820a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:30 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (03d6a7fe-f4a3-4394-ac3d-a42c6cb865ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:30 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-92b6a7a1-d286-463b-8f49-6d5c95d3d09d tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-ae1d83f8-b095-49b0-a213-e2c43e59ee25-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Lock "cinder-ae1d83f8-b095-49b0-a213-e2c43e59ee25-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-ae1d83f8-b095-49b0-a213-e2c43e59ee25" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-ae1d83f8-b095-49b0-a213-e2c43e59ee25" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a15a368-cf67-41e1-ac25-5bb1a72e95fa]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:31 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 Sep 11 14:08:31 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:31 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25" returned: 0 in 0.452s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:31 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25 Sep 11 14:08:31 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot 529db7df-f227-457a-bb1b-9db6367f1249 of volume 8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01cfc58-eebc-49be-a7ef-516d142797a1]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:31 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 Sep 11 14:08:31 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:31 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-ae1d83f8-b095-49b0-a213-e2c43e59ee25" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-ae1d83f8-b095-49b0-a213-e2c43e59ee25" released by "delete_volume" :: held 0.905s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Created reservations ['3ff5d363-1237-4d23-b51e-6dd16996aedb', 'df8bcd2b-f798-48e9-9d04-5e951f28e5fd', 'f0c3b304-76b6-4391-912c-05bd03d2748a', '5ca3a19a-f538-46fa-ba49-716fd7ca84ca'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:32 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:32 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:32 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831" returned: 0 in 0.506s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:32 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 1G Sep 11 14:08:32 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:32 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:32 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Deleted volume successfully. Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-9c800e53-bd73-4d67-b2b9-373683f38308 tempest-ProjectReaderTests-840254707 None] Lock "cinder-ae1d83f8-b095-49b0-a213-e2c43e59ee25-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:32 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (24555ac4-b31e-4925-9dc6-088cfb67e320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd97340b-a9d5-4db6-b502-b0822e384a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:33 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 1G" returned: 0 in 0.669s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b5a1541-d8da-4290-a56c-d0194331e831 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd97340b-a9d5-4db6-b502-b0822e384a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963229004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75785c-01f4-4588-b627-467725537fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:33Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:33 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b5a1541-d8da-4290-a56c-d0194331e831 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 Sep 11 14:08:33 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f74515-91d1-44b2-83cc-e4988552c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f74515-91d1-44b2-83cc-e4988552c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9186e748-1a25-4541-84dd-d4be5ea56b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9186e748-1a25-4541-84dd-d4be5ea56b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d75785c-01f4-4588-b627-467725537fec', 'volume_name': 'volume-6d75785c-01f4-4588-b627-467725537fec', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107215e9-56a3-4823-a93e-0b566caf919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107215e9-56a3-4823-a93e-0b566caf919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937c2c23-4274-4b69-959f-e83b3304577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:33 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Volume 6d75785c-01f4-4588-b627-467725537fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d75785c-01f4-4588-b627-467725537fec', 'volume_size': 1} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:33 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b5a1541-d8da-4290-a56c-d0194331e831 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249" returned: 0 in 0.377s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:33 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 is being set with open permissions: ugo+rw Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:33 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 Sep 11 14:08:33 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:33 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249" returned: 0 in 0.287s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:33 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info Sep 11 14:08:33 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:33 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info" returned: 0 in 0.273s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:33 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info is being set with open permissions: ugo+rw Sep 11 14:08:33 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:34 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info Sep 11 14:08:34 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:34 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.info" returned: 0 in 0.266s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963229004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75785c-01f4-4588-b627-467725537fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fe9cf91e4419f8dbf15fb629d9dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:33Z,use_quota=True,user_id='8b5a7395b1674a7aac4bb53b4be9392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Creating volume 6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:34 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:34 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec 1073741824 Sep 11 14:08:34 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:34 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e049c138-9755-4244-9cb8-411722c5f332 tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:08:34 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec 1073741824" returned: 0 in 0.408s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:34 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec Sep 11 14:08:34 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-529db7df-f227-457a-bb1b-9db6367f1249-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:34 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Lock "cinder-529db7df-f227-457a-bb1b-9db6367f1249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:34 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-8b5a1541-d8da-4290-a56c-d0194331e831" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937c2c23-4274-4b69-959f-e83b3304577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d75785c-01f4-4588-b627-467725537fec', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a91224-7c1c-4488-9ebc-a80c9a180dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-8b5a1541-d8da-4290-a56c-d0194331e831" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-529db7df-f227-457a-bb1b-9db6367f1249" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:35 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Volume volume-6d75785c-01f4-4588-b627-467725537fec (6d75785c-01f4-4588-b627-467725537fec): created successfully Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a91224-7c1c-4488-9ebc-a80c9a180dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Flow 'volume_create_manager' (24555ac4-b31e-4925-9dc6-088cfb67e320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-529db7df-f227-457a-bb1b-9db6367f1249" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot 529db7df-f227-457a-bb1b-9db6367f1249 of volume 8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:35 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ce6563db-90e8-416d-b088-0b44fc5db1cf tempest-ProjectReaderTests-840254707 None] Created volume successfully. Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff34e4-322a-4665-808d-80c279a97fb0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:35 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 Sep 11 14:08:35 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:35 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249" returned: 0 in 0.421s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b5a1541-d8da-4290-a56c-d0194331e831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f252783c-dfc7-4399-bd44-dd5c9b56a4b6]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:35 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 Sep 11 14:08:35 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:35 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831" returned: 0 in 0.407s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:35 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:35 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 Sep 11 14:08:35 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Creating offline snapshot 140bb947-0856-45bf-aa3f-51fdd65c9dd8 of volume 6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee70a5b5-3e08-441d-a7f7-5970ea782992]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:36 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249" returned: 0 in 0.434s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:36 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249 Sep 11 14:08:36 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:36 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec Sep 11 14:08:36 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:36 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831.529db7df-f227-457a-bb1b-9db6367f1249" returned: 0 in 0.268s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-529db7df-f227-457a-bb1b-9db6367f1249" released by "_delete_snapshot" :: held 1.652s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-8b5a1541-d8da-4290-a56c-d0194331e831" released by "delete_snapshot" :: held 1.693s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:36 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec" returned: 0 in 0.390s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:36 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 1G Sep 11 14:08:36 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Created reservations ['59718aa8-f07e-416b-a383-6a3db0fb5349', '12431abe-76c1-4e91-9d85-fa70b9792405', '808d5aef-5355-4784-80db-592412b336f3', '4c88f101-b5cf-4c78-bade-e5a52a61b2e7'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:36 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:08:36 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c2cbcbb1-531d-44b5-9ac1-784ae53d94ff tempest-ProjectMemberTests-1521204887 None] Lock "cinder-529db7df-f227-457a-bb1b-9db6367f1249-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:37 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 1G" returned: 0 in 0.468s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d75785c-01f4-4588-b627-467725537fec -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:37 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d75785c-01f4-4588-b627-467725537fec -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 Sep 11 14:08:37 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-8b5a1541-d8da-4290-a56c-d0194331e831-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-8b5a1541-d8da-4290-a56c-d0194331e831-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-8b5a1541-d8da-4290-a56c-d0194331e831" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-8b5a1541-d8da-4290-a56c-d0194331e831" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebc42e7-798f-452d-b7b3-b119c0a9e820]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:37 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 Sep 11 14:08:37 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:37 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d75785c-01f4-4588-b627-467725537fec -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8" returned: 0 in 0.356s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:37 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 is being set with open permissions: ugo+rw Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:37 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 Sep 11 14:08:37 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:37 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831" returned: 0 in 0.425s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:37 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831 Sep 11 14:08:37 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:37 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8" returned: 0 in 0.277s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:37 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:37 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info Sep 11 14:08:37 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:38 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-8b5a1541-d8da-4290-a56c-d0194331e831" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-8b5a1541-d8da-4290-a56c-d0194331e831" released by "delete_volume" :: held 0.759s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Created reservations ['e10810ec-eee9-48d9-905b-6d81362ea422', '20620c0b-f627-485b-af54-339a24c292c4', 'b9d710c4-a29e-4c60-b2de-8365995e4d53', '91fb9a96-d308-4b92-870d-39ae0172cc39'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:38 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info" returned: 0 in 0.295s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:38 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info is being set with open permissions: ugo+rw Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:38 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info Sep 11 14:08:38 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:38 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:38 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:38 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.info" returned: 0 in 0.298s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-243551d8-e85f-486c-b48c-7773e8db4ba3 tempest-ProjectReaderTests-840254707 None] Create snapshot completed successfully Sep 11 14:08:38 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.283s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:38 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-dd08a7a9-fe50-4986-92ac-babdb5718193 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-8b5a1541-d8da-4290-a56c-d0194331e831-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:38 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (48af1229-3d82-46be-b958-75223c140c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764c4b11-6bdd-4917-81b8-4ffcf803f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764c4b11-6bdd-4917-81b8-4ffcf803f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129880026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed0b8ed-0058-4d89-96a9-a708e8c79536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:39Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d98a89-b297-4a38-8714-d2d85ad7f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d98a89-b297-4a38-8714-d2d85ad7f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8ce85a-40ad-4412-a1a5-844da45401a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8ce85a-40ad-4412-a1a5-844da45401a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed0b8ed-0058-4d89-96a9-a708e8c79536', 'volume_name': 'volume-bed0b8ed-0058-4d89-96a9-a708e8c79536', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4aff27-6fe7-4c47-be16-a62cff3e6b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4aff27-6fe7-4c47-be16-a62cff3e6b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d724860-f51c-47ea-9662-c857ef8a85a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:39 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Volume bed0b8ed-0058-4d89-96a9-a708e8c79536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed0b8ed-0058-4d89-96a9-a708e8c79536', 'volume_size': 1} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129880026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed0b8ed-0058-4d89-96a9-a708e8c79536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:39Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Creating volume bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:39 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:39 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 1073741824 Sep 11 14:08:39 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:39 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 1073741824" returned: 0 in 0.419s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-140bb947-0856-45bf-aa3f-51fdd65c9dd8-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Lock "cinder-140bb947-0856-45bf-aa3f-51fdd65c9dd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-6d75785c-01f4-4588-b627-467725537fec" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-6d75785c-01f4-4588-b627-467725537fec" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-140bb947-0856-45bf-aa3f-51fdd65c9dd8" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:39 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 Sep 11 14:08:39 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-140bb947-0856-45bf-aa3f-51fdd65c9dd8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Deleting offline snapshot 140bb947-0856-45bf-aa3f-51fdd65c9dd8 of volume 6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] snapshot_file for this snap is: volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65036ba-451e-4992-b7ed-582e97fcbc82]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:39 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 Sep 11 14:08:39 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536" returned: 0 in 0.358s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:39 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d724860-f51c-47ea-9662-c857ef8a85a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed0b8ed-0058-4d89-96a9-a708e8c79536', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:39 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec08d65-4fad-48ab-9d6e-cad89d10ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:40 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Volume volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 (bed0b8ed-0058-4d89-96a9-a708e8c79536): created successfully Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec08d65-4fad-48ab-9d6e-cad89d10ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (48af1229-3d82-46be-b958-75223c140c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:40 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6379971e-c542-42df-8b63-d330e2838b75 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:08:40 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8" returned: 0 in 0.550s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d75785c-01f4-4588-b627-467725537fec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93582a-0136-4476-85b0-d47ac8f71ad6]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:40 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec Sep 11 14:08:40 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:40 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:40 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 Sep 11 14:08:40 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:40 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:40 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8" returned: 0 in 0.367s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:41 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8 Sep 11 14:08:41 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:41 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec.140bb947-0856-45bf-aa3f-51fdd65c9dd8" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-140bb947-0856-45bf-aa3f-51fdd65c9dd8" released by "_delete_snapshot" :: held 1.688s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-6d75785c-01f4-4588-b627-467725537fec" released by "delete_snapshot" :: held 1.722s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Created reservations ['0b6ae1f0-4e70-4b0f-ae24-045df319e233', '064bc6d2-028f-43e8-b90d-58d6f1649ae2', '43988af3-962e-4625-82b3-85600bddceca', 'b00837ea-407b-4e91-a8bd-75cf3b8128ce'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot 0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 of volume bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea46fd-89a5-441e-8989-4d584cd167fd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:41 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Delete snapshot completed successfully. Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-b196cf90-5592-44e1-84ad-19ca9737dc94 tempest-ProjectReaderTests-840254707 None] Lock "cinder-140bb947-0856-45bf-aa3f-51fdd65c9dd8-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:41 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 Sep 11 14:08:41 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-6d75785c-01f4-4588-b627-467725537fec-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Lock "cinder-6d75785c-01f4-4588-b627-467725537fec-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Acquiring lock "cinder-quobyte-6d75785c-01f4-4588-b627-467725537fec" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-6d75785c-01f4-4588-b627-467725537fec" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:41 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536" returned: 0 in 0.443s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b87307-a3a6-41e5-96fb-4580e9ab0853]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:41 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:41 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 1G Sep 11 14:08:41 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:42 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec Sep 11 14:08:42 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:42 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec" returned: 0 in 0.401s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:42 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec Sep 11 14:08:42 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:42 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 1G" returned: 0 in 0.481s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:42 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 Sep 11 14:08:42 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:42 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6d75785c-01f4-4588-b627-467725537fec" returned: 0 in 0.297s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Lock "cinder-quobyte-6d75785c-01f4-4588-b627-467725537fec" released by "delete_volume" :: held 0.787s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Created reservations ['d0b43653-dcd9-4405-aab9-6e628646d78f', 'c019b7a2-f62e-4f54-ad3f-700bf5525623', 'f3ce10c4-f9f5-42dd-90dc-3862f045c56e', '16d98c88-b14a-490e-837c-42ebd8cbb59d'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:42 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" returned: 0 in 0.348s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:42 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 is being set with open permissions: ugo+rw Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:42 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 Sep 11 14:08:42 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:42 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:42 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:42 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:43 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" returned: 0 in 0.305s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:43 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.292s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Deleted volume successfully. Sep 11 14:08:43 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info Sep 11 14:08:43 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4e4a5d78-8c07-469e-b40e-ddf652f5e5fb tempest-ProjectReaderTests-840254707 None] Lock "cinder-6d75785c-01f4-4588-b627-467725537fec-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:43 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info" returned: 0 in 0.280s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:43 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info is being set with open permissions: ugo+rw Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:43 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info Sep 11 14:08:43 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:43 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.info" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:43 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:43 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-76dbab24-a7b5-4dcf-9724-f8fa9ee890fb tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-0ff4f0c3-b98f-4429-955d-6ae8fedf93a3-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-0ff4f0c3-b98f-4429-955d-6ae8fedf93a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-bed0b8ed-0058-4d89-96a9-a708e8c79536" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-bed0b8ed-0058-4d89-96a9-a708e8c79536" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot 0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 of volume bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc628f2-a644-45da-9372-a96855c51c92]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:44 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:44 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 Sep 11 14:08:44 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:45 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" returned: 0 in 0.366s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bed0b8ed-0058-4d89-96a9-a708e8c79536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eaba2d-455b-4ca9-b153-a55cfd8d8e16]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:45 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 Sep 11 14:08:45 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:45 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536" returned: 0 in 0.362s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:45 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 Sep 11 14:08:45 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:45 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" returned: 0 in 0.333s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:45 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:45 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3 Sep 11 14:08:45 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:46 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536.0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-0ff4f0c3-b98f-4429-955d-6ae8fedf93a3" released by "_delete_snapshot" :: held 1.419s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-bed0b8ed-0058-4d89-96a9-a708e8c79536" released by "delete_snapshot" :: held 1.442s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Created reservations ['ec845b1e-edfd-4225-a484-55396d80abad', 'cdaea909-413a-461c-86ee-60d5fd536366', '5545597f-9807-4abc-bd6b-c083cee9f77a', '9b776e0a-21c3-4d6c-95e8-e80e378c0984'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:46 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-e41731ce-ecc4-4e6b-8aaf-380baaa05363 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-0ff4f0c3-b98f-4429-955d-6ae8fedf93a3-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-bed0b8ed-0058-4d89-96a9-a708e8c79536-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-bed0b8ed-0058-4d89-96a9-a708e8c79536-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-bed0b8ed-0058-4d89-96a9-a708e8c79536" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-bed0b8ed-0058-4d89-96a9-a708e8c79536" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dfd859-1b53-47b0-9771-cb628c7c0fca]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:46 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:46 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 Sep 11 14:08:46 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:47 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536" returned: 0 in 0.352s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:47 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536 Sep 11 14:08:47 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:47 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-bed0b8ed-0058-4d89-96a9-a708e8c79536" returned: 0 in 0.239s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-bed0b8ed-0058-4d89-96a9-a708e8c79536" released by "delete_volume" :: held 0.642s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Created reservations ['1b40f023-02eb-4a5c-a220-429f94e5de44', '2335bae2-ddda-4ffc-b2ba-26145f2d37de', 'c67d9b74-c8bf-43d7-9883-29026968e734', '84c0a8a8-211a-4328-bf40-c8276cb52106'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:47 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:47 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:47 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:47 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:08:47 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d1c7ed93-bf3d-4876-9788-a5f1ae7a8ac6 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-bed0b8ed-0058-4d89-96a9-a708e8c79536-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (4c49fc28-902f-4f89-b0d7-33c45e05c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f1c138-5ad5-444e-9a0a-d89a425fad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f1c138-5ad5-444e-9a0a-d89a425fad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-502156788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b2555f-01d1-4bfd-815b-45ae61819ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:48Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da2edc9-693d-4b5a-bca0-0c1644bdfd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da2edc9-693d-4b5a-bca0-0c1644bdfd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c970c83-7e3c-4f0f-aacc-1384353e9ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c970c83-7e3c-4f0f-aacc-1384353e9ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b2555f-01d1-4bfd-815b-45ae61819ed4', 'volume_name': 'volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c80c97-74c4-4823-985e-a23300a93fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c80c97-74c4-4823-985e-a23300a93fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c92e8-0a84-46ea-8744-5b1fdf2cfd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:48 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Volume c9b2555f-01d1-4bfd-815b-45ae61819ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4', 'volume_size': 1} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-502156788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b2555f-01d1-4bfd-815b-45ae61819ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:48Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Creating volume c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:48 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:48 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 1073741824 Sep 11 14:08:48 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:48 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 1073741824" returned: 0 in 0.405s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:48 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:48 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 Sep 11 14:08:48 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:49 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c92e8-0a84-46ea-8744-5b1fdf2cfd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9651eeb-03eb-40ba-b170-6531f70a3710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:49 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Volume volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 (c9b2555f-01d1-4bfd-815b-45ae61819ed4): created successfully Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9651eeb-03eb-40ba-b170-6531f70a3710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (4c49fc28-902f-4f89-b0d7-33c45e05c33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:49 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d3955a0e-a357-4f85-883e-b994ec499688 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot 01a428d1-a56f-4cdb-aec4-41a53b3f8a9b of volume c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a48072-a6b6-49dc-806e-6c2eb47e8e7f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:49 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 Sep 11 14:08:49 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:49 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4" returned: 0 in 0.380s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:49 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:49 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b 1G Sep 11 14:08:49 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:50 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b 1G" returned: 0 in 0.407s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:50 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b Sep 11 14:08:50 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:50 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" returned: 0 in 0.292s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:50 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b is being set with open permissions: ugo+rw Sep 11 14:08:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:50 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b Sep 11 14:08:50 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:50 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:50 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:50 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info Sep 11 14:08:50 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:51 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info" returned: 0 in 0.258s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:51 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info is being set with open permissions: ugo+rw Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:51 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info Sep 11 14:08:51 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:51 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.info" returned: 0 in 0.248s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:51 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a8258e13-20a9-47ff-bb99-5e6e545ccbfe tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-01a428d1-a56f-4cdb-aec4-41a53b3f8a9b-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-01a428d1-a56f-4cdb-aec4-41a53b3f8a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-c9b2555f-01d1-4bfd-815b-45ae61819ed4" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c9b2555f-01d1-4bfd-815b-45ae61819ed4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot 01a428d1-a56f-4cdb-aec4-41a53b3f8a9b of volume c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06dc68f-d610-44fd-93ea-693a7daaa5b8]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:51 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:51 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b Sep 11 14:08:51 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:52 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" returned: 0 in 0.372s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f357c0a6-31ab-4b39-a5ee-330f08ad3c78]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:52 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 Sep 11 14:08:52 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:52 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4" returned: 0 in 0.386s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:52 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b Sep 11 14:08:52 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:52 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" returned: 0 in 0.362s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:52 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:52 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b Sep 11 14:08:52 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:53 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4.01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" returned: 0 in 0.273s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-01a428d1-a56f-4cdb-aec4-41a53b3f8a9b" released by "_delete_snapshot" :: held 1.497s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c9b2555f-01d1-4bfd-815b-45ae61819ed4" released by "delete_snapshot" :: held 1.520s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Created reservations ['30e3365a-00fc-4991-b83f-629651da6acd', 'a4f68553-5dfc-457f-8a71-f81fe4df6894', 'd52b08a7-8a93-4873-8a64-551db88c59f2', 'cbcd940d-e733-46a6-9510-a8ea68a3d25a'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:53 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-04b925bb-3d2d-4dc1-a6e9-75e0cab3a352 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-01a428d1-a56f-4cdb-aec4-41a53b3f8a9b-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-c9b2555f-01d1-4bfd-815b-45ae61819ed4-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c9b2555f-01d1-4bfd-815b-45ae61819ed4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-c9b2555f-01d1-4bfd-815b-45ae61819ed4" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c9b2555f-01d1-4bfd-815b-45ae61819ed4" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262529c-4eb0-49dd-8c7f-8376e9a37d4a]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:53 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:54 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 Sep 11 14:08:54 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:54 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4" returned: 0 in 0.379s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:54 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4 Sep 11 14:08:54 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:54 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c9b2555f-01d1-4bfd-815b-45ae61819ed4" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c9b2555f-01d1-4bfd-815b-45ae61819ed4" released by "delete_volume" :: held 0.698s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Created reservations ['457baf13-3da4-4121-89d0-74d05b3424ca', '43b8d3e9-9c20-465b-a3f8-c940fdf3a560', 'c57e57f7-2f15-40db-a1a7-3b33667774de', '37361098-caaf-4c6d-b3f6-a5529501bedc'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:54 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:08:54 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:54 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.281s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:54 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:08:55 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7305f732-e1f9-4066-ad7b-12b4a39664a8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c9b2555f-01d1-4bfd-815b-45ae61819ed4-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (1a0d54a6-7e80-46b0-a1bc-6fa008bfa61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796f8ad9-4df0-47d8-bbc8-0c6ea7f3590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796f8ad9-4df0-47d8-bbc8-0c6ea7f3590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632599672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:55Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58933d98-a604-452b-ad68-0c8833525a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58933d98-a604-452b-ad68-0c8833525a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43545f48-bb84-4620-8c8e-0ba248b5d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43545f48-bb84-4620-8c8e-0ba248b5d994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788', 'volume_name': 'volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5a4d1d-6434-417e-9850-11e25c4b9a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d5a4d1d-6434-417e-9850-11e25c4b9a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b061aa-61e4-4938-8d1a-ca66c4542742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:55 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Volume 6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788', 'volume_size': 1} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632599672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:08:55Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Creating volume 6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:08:55 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:08:55 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:55 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 1073741824 Sep 11 14:08:55 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:56 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 1073741824" returned: 0 in 0.428s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:56 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 Sep 11 14:08:56 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:56 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b061aa-61e4-4938-8d1a-ca66c4542742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283d7b81-d1e6-48e0-be8d-c366939b387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:08:56 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Volume volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 (6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788): created successfully Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283d7b81-d1e6-48e0-be8d-c366939b387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (1a0d54a6-7e80-46b0-a1bc-6fa008bfa61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:08:56 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-28a4350f-7fca-4c75-9de9-66b98108fe96 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot c3b00003-4b84-46d8-8e6c-0fe9803d52b7 of volume 6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9139b42-c7ca-499d-b1f8-19b7b0089c58]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:56 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:56 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 Sep 11 14:08:56 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:57 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" returned: 0 in 0.379s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:57 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 1G Sep 11 14:08:57 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:57 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 1G" returned: 0 in 0.415s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:57 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 Sep 11 14:08:57 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:57 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7" returned: 0 in 0.310s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:57 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 is being set with open permissions: ugo+rw Sep 11 14:08:57 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:57 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 Sep 11 14:08:57 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:58 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7" returned: 0 in 0.266s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:58 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info Sep 11 14:08:58 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:58 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:58 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info is being set with open permissions: ugo+rw Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:58 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info Sep 11 14:08:58 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:58 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.info" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:08:58 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a69b9ba4-c4d0-4961-a7f8-c93c55f29ca4 tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-c3b00003-4b84-46d8-8e6c-0fe9803d52b7-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c3b00003-4b84-46d8-8e6c-0fe9803d52b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-c3b00003-4b84-46d8-8e6c-0fe9803d52b7" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c3b00003-4b84-46d8-8e6c-0fe9803d52b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot c3b00003-4b84-46d8-8e6c-0fe9803d52b7 of volume 6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0384973-4e63-4464-9bbb-b640b54cb705]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:58 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:59 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 Sep 11 14:08:59 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:59 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7" returned: 0 in 0.367s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:59 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:08:59 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91d8cf5-e663-467c-be8e-2d1fd53dcf11]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:08:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:59 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 Sep 11 14:08:59 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:08:59 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Sep 11 14:08:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:08:59 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:08:59 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 Sep 11 14:08:59 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:00 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7" returned: 0 in 0.364s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:00 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7 Sep 11 14:09:00 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:00 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788.c3b00003-4b84-46d8-8e6c-0fe9803d52b7" returned: 0 in 0.262s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c3b00003-4b84-46d8-8e6c-0fe9803d52b7" released by "_delete_snapshot" :: held 1.469s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" released by "delete_snapshot" :: held 1.490s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Created reservations ['dd6f53b7-dbe6-4e88-a0d4-0a14dfebe695', 'c1b7f863-e846-4bc1-aaec-4bb44f60da84', '49696673-8a26-4be4-b9b0-7551b85b2422', '8e1b90fc-e619-44ce-afee-7dbb0e3baaba'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:00 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7ced9baf-dafd-408e-a3f4-0948343054e1 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c3b00003-4b84-46d8-8e6c-0fe9803d52b7-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:00 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" acquired by "delete_volume" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb22ce-0a27-449c-b47f-67d530f302e9]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:01 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 Sep 11 14:09:01 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:01 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" returned: 0 in 0.381s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:01 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788 Sep 11 14:09:01 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:01 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788" released by "delete_volume" :: held 0.704s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Created reservations ['18f5e01c-92cb-46b4-8781-021fa05c126a', '30926c9f-86e2-4f0f-bbb8-682e81334e55', '0ee1a9d2-89f6-4527-9b32-e81b60d56e7b', '28c576c7-4eb9-4fea-9eb3-90fb4d50a3db'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:01 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:01 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:01 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:02 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:02 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-cfeb921b-f8ff-4732-92ba-9841e2c10474 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-6c8fb6d6-5d6a-4663-8f2e-b3b5ddf7f788-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (02ffd714-886e-488e-8029-6f993556f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f56954c-c9fa-466e-8cb3-2da3f54af901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f56954c-c9fa-466e-8cb3-2da3f54af901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327410585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cda485-fd74-4101-8819-f9cea5f6c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:03Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624e5404-3502-4a0c-ad66-3811044d9e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624e5404-3502-4a0c-ad66-3811044d9e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87215b3c-54a9-4a09-868e-748c64e63499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87215b3c-54a9-4a09-868e-748c64e63499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7cda485-fd74-4101-8819-f9cea5f6c0de', 'volume_name': 'volume-c7cda485-fd74-4101-8819-f9cea5f6c0de', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2ec02b-5914-4679-b009-93e1f9e3e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2ec02b-5914-4679-b009-93e1f9e3e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46eda7-8439-4db1-a5ec-5665746af980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:02 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Volume c7cda485-fd74-4101-8819-f9cea5f6c0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7cda485-fd74-4101-8819-f9cea5f6c0de', 'volume_size': 1} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327410585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cda485-fd74-4101-8819-f9cea5f6c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:03Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Creating volume c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:02 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:02 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:02 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de 1073741824 Sep 11 14:09:02 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:03 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de 1073741824" returned: 0 in 0.440s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:03 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de Sep 11 14:09:03 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:03 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46eda7-8439-4db1-a5ec-5665746af980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cda485-fd74-4101-8819-f9cea5f6c0de', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e202008-4d9b-4873-aa0d-a50dda05564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=166,cinder:UPDATE=204,cinder:INSERT=56,cinder:DELETE=24 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:09:03 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Volume volume-c7cda485-fd74-4101-8819-f9cea5f6c0de (c7cda485-fd74-4101-8819-f9cea5f6c0de): created successfully Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e202008-4d9b-4873-aa0d-a50dda05564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (02ffd714-886e-488e-8029-6f993556f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:03 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a1d2cbe7-6001-4f0f-a2b7-a7a628b56f7c tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=173,cinder:INSERT=66,cinder:UPDATE=217,cinder:DELETE=10 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot dccb6996-69f5-4f4e-a813-1aa785da0ea1 of volume c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17688208-e488-486b-a8a9-28d4fb68c2ba]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:03 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:03 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de Sep 11 14:09:03 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:04 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de" returned: 0 in 0.390s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:04 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 1G Sep 11 14:09:04 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:04 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 1G" returned: 0 in 0.405s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cda485-fd74-4101-8819-f9cea5f6c0de -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:04 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cda485-fd74-4101-8819-f9cea5f6c0de -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 Sep 11 14:09:04 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:04 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cda485-fd74-4101-8819-f9cea5f6c0de -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1" returned: 0 in 0.300s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:04 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 is being set with open permissions: ugo+rw Sep 11 14:09:04 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:04 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 Sep 11 14:09:04 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:05 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:05 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info Sep 11 14:09:05 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:05 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:05 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info is being set with open permissions: ugo+rw Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:05 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info Sep 11 14:09:05 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:05 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.info" returned: 0 in 0.271s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:05 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-9d6b904d-a4e4-446b-9db9-9fecd1ba346d tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-dccb6996-69f5-4f4e-a813-1aa785da0ea1-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-dccb6996-69f5-4f4e-a813-1aa785da0ea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-c7cda485-fd74-4101-8819-f9cea5f6c0de" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c7cda485-fd74-4101-8819-f9cea5f6c0de" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-dccb6996-69f5-4f4e-a813-1aa785da0ea1" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-dccb6996-69f5-4f4e-a813-1aa785da0ea1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:05 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot dccb6996-69f5-4f4e-a813-1aa785da0ea1 of volume c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3635ca7-d2b7-42a9-bba8-9056416f3aa0]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:06 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 Sep 11 14:09:06 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:06 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1" returned: 0 in 0.375s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7cda485-fd74-4101-8819-f9cea5f6c0de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c43fd3-2912-47ca-85fa-dd6bdfc5d06d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:06 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de Sep 11 14:09:06 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (230a2382-7e91-474e-96a9-3f41c2aaa20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e89b2ff-70a7-4b93-90a1-1d884d570f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e89b2ff-70a7-4b93-90a1-1d884d570f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166811076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b4c816-b765-410a-bd01-eacb479da8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:07Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fda170-6708-4002-a928-b5bc775fa436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fda170-6708-4002-a928-b5bc775fa436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fdc270-c342-4256-a18a-4dd654770840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fdc270-c342-4256-a18a-4dd654770840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b4c816-b765-410a-bd01-eacb479da8fd', 'volume_name': 'volume-99b4c816-b765-410a-bd01-eacb479da8fd', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13403a6e-5268-467d-8bd9-021bcfe0a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13403a6e-5268-467d-8bd9-021bcfe0a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f479a6b9-e207-4f09-b044-be8fda8ad632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:06 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Volume 99b4c816-b765-410a-bd01-eacb479da8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b4c816-b765-410a-bd01-eacb479da8fd', 'volume_size': 1} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166811076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b4c816-b765-410a-bd01-eacb479da8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:07Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Creating volume 99b4c816-b765-410a-bd01-eacb479da8fd {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:06 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:06 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd 1073741824 Sep 11 14:09:06 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:06 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de" returned: 0 in 0.404s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:06 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:06 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 Sep 11 14:09:06 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:07 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:07 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd 1073741824" returned: 0 in 0.449s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1" returned: 0 in 0.397s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:07 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1 Sep 11 14:09:07 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:07 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd Sep 11 14:09:07 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:07 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de.dccb6996-69f5-4f4e-a813-1aa785da0ea1" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-dccb6996-69f5-4f4e-a813-1aa785da0ea1" released by "_delete_snapshot" :: held 1.530s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c7cda485-fd74-4101-8819-f9cea5f6c0de" released by "delete_snapshot" :: held 1.551s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:07 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd" returned: 0 in 0.261s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f479a6b9-e207-4f09-b044-be8fda8ad632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b4c816-b765-410a-bd01-eacb479da8fd', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cacfea8-1b9e-4d36-b78e-ac387e3ade23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:07 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Volume volume-99b4c816-b765-410a-bd01-eacb479da8fd (99b4c816-b765-410a-bd01-eacb479da8fd): created successfully Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cacfea8-1b9e-4d36-b78e-ac387e3ade23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (230a2382-7e91-474e-96a9-3f41c2aaa20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5347904e-fb51-4cb1-87c0-36a903ee3c93 tempest-ProjectReaderTests-769221937 None] Created volume successfully. Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Created reservations ['1358ecfb-5e39-4635-b874-e0f78cd85e7d', 'd5e8872f-10c0-4e9c-90ba-1ccb5320d3a9', 'a737104e-e032-4dfa-a4c9-ebd4b03eeb25', 'ef0ee5ba-06d4-4b71-85f3-6abecddf19df'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:07 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:09:07 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-6c3aa0a9-9e91-4f00-b746-67a33f39da82 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-dccb6996-69f5-4f4e-a813-1aa785da0ea1-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-c7cda485-fd74-4101-8819-f9cea5f6c0de-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c7cda485-fd74-4101-8819-f9cea5f6c0de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-c7cda485-fd74-4101-8819-f9cea5f6c0de" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c7cda485-fd74-4101-8819-f9cea5f6c0de" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d2dfb2-71a5-4909-b024-ab4d5b3df602]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:08 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de Sep 11 14:09:08 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:08 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de" returned: 0 in 0.357s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:08 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de Sep 11 14:09:08 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:08 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c7cda485-fd74-4101-8819-f9cea5f6c0de" returned: 0 in 0.249s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c7cda485-fd74-4101-8819-f9cea5f6c0de" released by "delete_volume" :: held 0.662s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Created reservations ['a33937fc-ea92-48cc-8653-570608ff41a8', '0dde266c-64dc-41e0-b888-37fd6b0c252b', 'f350159d-7c29-4627-b755-8b12e07db93c', '2826323c-f84b-401e-89ea-a1e0b35ffd46'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-99b4c816-b765-410a-bd01-eacb479da8fd-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Lock "cinder-99b4c816-b765-410a-bd01-eacb479da8fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-quobyte-99b4c816-b765-410a-bd01-eacb479da8fd" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:08 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-99b4c816-b765-410a-bd01-eacb479da8fd" acquired by "delete_volume" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48a55b5-eedc-4090-87b0-c3dcd5c75f06]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:09 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:09 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:09 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd Sep 11 14:09:09 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:09 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:09 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-33b57d5b-726d-4547-b757-45cdbf034cd2 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c7cda485-fd74-4101-8819-f9cea5f6c0de-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:09 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd" returned: 0 in 0.378s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:09 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd Sep 11 14:09:09 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:09 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-99b4c816-b765-410a-bd01-eacb479da8fd" returned: 0 in 0.264s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-99b4c816-b765-410a-bd01-eacb479da8fd" released by "delete_volume" :: held 0.690s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (1047ffd3-fbd5-4450-9f75-54979bdb029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b1eb41-ada5-43f5-a07d-d6278c49e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Created reservations ['01126aa5-944e-4bb9-8541-13ed707030b1', 'de06ecc7-732c-4b3a-95db-a6b06bbaa5f4', '49cf635d-8c6a-42be-b8f5-5bc4fee9c97f', '9af30b9a-b1ec-44c9-9c2c-f9ceac9db68e'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b1eb41-ada5-43f5-a07d-d6278c49e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484851138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d4d3fc-589c-46c2-97c2-b758f669de36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:10Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dcc58e-2514-4d1e-9dcd-9ccb2cbaaca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dcc58e-2514-4d1e-9dcd-9ccb2cbaaca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1557d4-694f-41af-ab17-f44e87a5ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1557d4-694f-41af-ab17-f44e87a5ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d4d3fc-589c-46c2-97c2-b758f669de36', 'volume_name': 'volume-61d4d3fc-589c-46c2-97c2-b758f669de36', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2552680a-b672-4ab2-aee7-b61ec50b8b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2552680a-b672-4ab2-aee7-b61ec50b8b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20c0013-8b8c-4f24-917e-ed1c0622d081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:09 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Volume 61d4d3fc-589c-46c2-97c2-b758f669de36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d4d3fc-589c-46c2-97c2-b758f669de36', 'volume_size': 1} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484851138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d4d3fc-589c-46c2-97c2-b758f669de36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:10Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Creating volume 61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:09 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:09 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 1073741824 Sep 11 14:09:09 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:09 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:09 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:09 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:10 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.267s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Deleted volume successfully. Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-d27fe5cd-2521-4521-807f-b0cd1d260b40 tempest-ProjectReaderTests-769221937 None] Lock "cinder-99b4c816-b765-410a-bd01-eacb479da8fd-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:10 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 1073741824" returned: 0 in 0.472s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:10 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 Sep 11 14:09:10 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (1a76a531-7a0a-4c03-a659-1a46f071b8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c56a67-432c-44af-99eb-5f39067a7195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:10 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36" returned: 0 in 0.270s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:10 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:10 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c56a67-432c-44af-99eb-5f39067a7195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-386183554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e3c19-ea42-4df1-a458-e534bb7e244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:10Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04fbf7e-a6a9-423e-835d-3e277f949261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04fbf7e-a6a9-423e-835d-3e277f949261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85b455a-aed7-4506-9780-146774532220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85b455a-aed7-4506-9780-146774532220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30e3c19-ea42-4df1-a458-e534bb7e244b', 'volume_name': 'volume-c30e3c19-ea42-4df1-a458-e534bb7e244b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53658ed-8529-4644-a3ec-eb8c2cba99b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53658ed-8529-4644-a3ec-eb8c2cba99b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e779ff6-1fc9-4dab-a4f5-94146c89e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Volume c30e3c19-ea42-4df1-a458-e534bb7e244b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30e3c19-ea42-4df1-a458-e534bb7e244b', 'volume_size': 1} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-386183554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e3c19-ea42-4df1-a458-e534bb7e244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:10Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Creating volume c30e3c19-ea42-4df1-a458-e534bb7e244b {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:10 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20c0013-8b8c-4f24-917e-ed1c0622d081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d4d3fc-589c-46c2-97c2-b758f669de36', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe40863d-6d84-4336-b56d-2b99bb4b7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:10 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b 1073741824 Sep 11 14:09:10 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:10 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Volume volume-61d4d3fc-589c-46c2-97c2-b758f669de36 (61d4d3fc-589c-46c2-97c2-b758f669de36): created successfully Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe40863d-6d84-4336-b56d-2b99bb4b7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (1047ffd3-fbd5-4450-9f75-54979bdb029b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:10 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-03f077e4-7b30-4546-922e-39357d222e29 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:09:10 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG oslo_service.periodic_task [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] Running periodic task VolumeManager._thread_info {{(pid=88731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread count: 28 {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 14:09:10 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-5736b36b-0791-4b10-ae59-2ebc9921fc89 None None] thread info: [<_MainThread(MainThread, started 125367892336768)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 14:09:11 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b 1073741824" returned: 0 in 0.415s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:11 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b Sep 11 14:09:11 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:11 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b" returned: 0 in 0.233s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e779ff6-1fc9-4dab-a4f5-94146c89e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30e3c19-ea42-4df1-a458-e534bb7e244b', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718ae7a9-ed44-4398-93c4-46473871d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:11 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Volume volume-c30e3c19-ea42-4df1-a458-e534bb7e244b (c30e3c19-ea42-4df1-a458-e534bb7e244b): created successfully Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718ae7a9-ed44-4398-93c4-46473871d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (1a76a531-7a0a-4c03-a659-1a46f071b8ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:11 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-313a86c8-5e82-4159-be43-aba6a1b6488d tempest-ProjectReaderTests-769221937 None] Created volume successfully. Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-c30e3c19-ea42-4df1-a458-e534bb7e244b-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Lock "cinder-c30e3c19-ea42-4df1-a458-e534bb7e244b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-quobyte-c30e3c19-ea42-4df1-a458-e534bb7e244b" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-c30e3c19-ea42-4df1-a458-e534bb7e244b" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b12e4f5-b675-4b9d-9bbc-3ff960c3ad93]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:11 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b Sep 11 14:09:11 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:11 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot 7b14401a-c844-4d0f-a58d-0712b74941e1 of volume 61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[991773ae-2d6e-4ee1-9b8e-8eddab12a01d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:12 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b" returned: 0 in 0.368s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:12 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b Sep 11 14:09:12 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:12 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 Sep 11 14:09:12 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:12 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-c30e3c19-ea42-4df1-a458-e534bb7e244b" returned: 0 in 0.251s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-c30e3c19-ea42-4df1-a458-e534bb7e244b" released by "delete_volume" :: held 0.659s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Created reservations ['309d7806-3ab7-4806-aa4f-5760fc10e544', 'b4d634a9-2723-400d-8021-234bde1d764b', '6c62e880-bc0c-4f26-aff2-fb1d301b81c0', 'd04fd004-8cb5-4096-8899-bf82b0e1e2ff'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:12 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:12 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 1G Sep 11 14:09:12 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:12 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:12 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:12 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:12 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Deleted volume successfully. Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-c8191748-04c4-4089-b2bf-991d2b45b2b0 tempest-ProjectReaderTests-769221937 None] Lock "cinder-c30e3c19-ea42-4df1-a458-e534bb7e244b-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:12 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 1G" returned: 0 in 0.425s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:12 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d4d3fc-589c-46c2-97c2-b758f669de36 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:12 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d4d3fc-589c-46c2-97c2-b758f669de36 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 Sep 11 14:09:12 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:13 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d4d3fc-589c-46c2-97c2-b758f669de36 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1" returned: 0 in 0.331s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:13 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 is being set with open permissions: ugo+rw Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:13 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 Sep 11 14:09:13 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (c7bad3b6-985c-4526-a470-84676744501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8801f128-6600-4deb-b7c2-ed74d03f7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8801f128-6600-4deb-b7c2-ed74d03f7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106528235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707c5012-25fc-4253-a145-efb5f3030cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:13Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5d430b-9452-4462-bf84-4b98a3feb552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5d430b-9452-4462-bf84-4b98a3feb552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ef3bad-b574-4bb3-a7dc-54364799ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ef3bad-b574-4bb3-a7dc-54364799ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707c5012-25fc-4253-a145-efb5f3030cc5', 'volume_name': 'volume-707c5012-25fc-4253-a145-efb5f3030cc5', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c74ac5a-07f8-4d22-afe5-67f9df39c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c74ac5a-07f8-4d22-afe5-67f9df39c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580b080a-13fe-487c-90f0-7a1b23b17181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:13 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Volume 707c5012-25fc-4253-a145-efb5f3030cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707c5012-25fc-4253-a145-efb5f3030cc5', 'volume_size': 1} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:13 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1" returned: 0 in 0.256s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:13 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info Sep 11 14:09:13 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:13 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info" returned: 0 in 0.250s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:13 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info is being set with open permissions: ugo+rw Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:13 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info Sep 11 14:09:13 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:13 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.info" returned: 0 in 0.234s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106528235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707c5012-25fc-4253-a145-efb5f3030cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:13Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Creating volume 707c5012-25fc-4253-a145-efb5f3030cc5 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:13 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:13 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:13 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 1073741824 Sep 11 14:09:13 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:13 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-ac36f0d9-23d1-4c37-a6b5-8314f81dfbfa tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-7b14401a-c844-4d0f-a58d-0712b74941e1-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-7b14401a-c844-4d0f-a58d-0712b74941e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-61d4d3fc-589c-46c2-97c2-b758f669de36" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-61d4d3fc-589c-46c2-97c2-b758f669de36" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-7b14401a-c844-4d0f-a58d-0712b74941e1" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-7b14401a-c844-4d0f-a58d-0712b74941e1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot 7b14401a-c844-4d0f-a58d-0712b74941e1 of volume 61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30656914-fd75-4594-b617-42a15771c3e5]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:14 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 Sep 11 14:09:14 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:14 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 1073741824" returned: 0 in 0.428s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:14 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 Sep 11 14:09:14 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:14 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1" returned: 0 in 0.376s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61d4d3fc-589c-46c2-97c2-b758f669de36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc07e6c-6e79-4d49-ae1e-4addd9cd87ea]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:14 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5" returned: 0 in 0.260s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580b080a-13fe-487c-90f0-7a1b23b17181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707c5012-25fc-4253-a145-efb5f3030cc5', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74432074-92b8-4969-be21-75ecbfcf0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:14 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Volume volume-707c5012-25fc-4253-a145-efb5f3030cc5 (707c5012-25fc-4253-a145-efb5f3030cc5): created successfully Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74432074-92b8-4969-be21-75ecbfcf0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (c7bad3b6-985c-4526-a470-84676744501b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:14 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-e2aad5f0-c1d9-4a64-8c43-aa354776c9c2 tempest-ProjectReaderTests-769221937 None] Created volume successfully. Sep 11 14:09:14 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 Sep 11 14:09:14 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:14 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36" returned: 0 in 0.351s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:14 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:14 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 Sep 11 14:09:14 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:15 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:15 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1 Sep 11 14:09:15 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-707c5012-25fc-4253-a145-efb5f3030cc5-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Lock "cinder-707c5012-25fc-4253-a145-efb5f3030cc5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-quobyte-707c5012-25fc-4253-a145-efb5f3030cc5" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-707c5012-25fc-4253-a145-efb5f3030cc5" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6f9370-5e68-4851-8ee9-afc6607821dd]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:15 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36.7b14401a-c844-4d0f-a58d-0712b74941e1" returned: 0 in 0.265s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:15 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 Sep 11 14:09:15 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-7b14401a-c844-4d0f-a58d-0712b74941e1" released by "_delete_snapshot" :: held 1.439s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-61d4d3fc-589c-46c2-97c2-b758f669de36" released by "delete_snapshot" :: held 1.467s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Created reservations ['ab9becfd-712b-45ca-bae8-edf5222a5d97', 'a62eb784-e47a-4b89-b905-5a2b2dad202c', 'd77a6085-9b0e-43e9-8d44-093dbbb4989a', 'e6572c0d-0d02-47f4-8b58-74667206b61c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:15 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-7c2b174f-7dcb-447c-8aa4-070cc7fcfdc8 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-7b14401a-c844-4d0f-a58d-0712b74941e1-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:15 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5" returned: 0 in 0.373s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:15 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:15 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5 Sep 11 14:09:15 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:16 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-707c5012-25fc-4253-a145-efb5f3030cc5" returned: 0 in 0.244s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-707c5012-25fc-4253-a145-efb5f3030cc5" released by "delete_volume" :: held 0.657s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Created reservations ['bc556ba3-f808-4672-b455-e528e14b7570', '686404a6-57b0-434d-8bd3-1d24d18d08c4', '5dcd3393-110a-4e47-8fbf-10552ac7ea6c', 'e8caa4fa-7b7a-4679-8c65-40b9a48c8255'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:16 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:16 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-61d4d3fc-589c-46c2-97c2-b758f669de36-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-61d4d3fc-589c-46c2-97c2-b758f669de36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-61d4d3fc-589c-46c2-97c2-b758f669de36" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-61d4d3fc-589c-46c2-97c2-b758f669de36" acquired by "delete_volume" :: waited 0.023s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f35bad-b9e1-489c-bca7-14095542135f]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:16 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.267s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:16 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Deleted volume successfully. Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-4dfb116f-258c-4d5a-b622-e5a112af39e8 tempest-ProjectReaderTests-769221937 None] Lock "cinder-707c5012-25fc-4253-a145-efb5f3030cc5-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:16 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 Sep 11 14:09:16 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:16 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36" returned: 0 in 0.386s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:16 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36 Sep 11 14:09:16 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:16 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (0c84102b-0f7b-483c-9e25-f7636a9ce647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b5fd77-20fa-4571-b868-6bc44741e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b5fd77-20fa-4571-b868-6bc44741e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667529764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78297ced-bdd8-4ee9-9287-802551463a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:17Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef47debe-a926-4b65-924f-fcffa94f418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef47debe-a926-4b65-924f-fcffa94f418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:17 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df298267-6611-4334-b7b6-709b34854b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df298267-6611-4334-b7b6-709b34854b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78297ced-bdd8-4ee9-9287-802551463a7a', 'volume_name': 'volume-78297ced-bdd8-4ee9-9287-802551463a7a', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beef593-46d4-4d08-a8d7-1ff359d037c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beef593-46d4-4d08-a8d7-1ff359d037c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f8daed-ee0f-4769-b82f-214a26b62b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:17 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Volume 78297ced-bdd8-4ee9-9287-802551463a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78297ced-bdd8-4ee9-9287-802551463a7a', 'volume_size': 1} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667529764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78297ced-bdd8-4ee9-9287-802551463a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ddba9039e645ad8ab5c3e773d27b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:17Z,use_quota=True,user_id='fdd91a43bd774b048f3263891c543e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Creating volume 78297ced-bdd8-4ee9-9287-802551463a7a {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:17 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-61d4d3fc-589c-46c2-97c2-b758f669de36" returned: 0 in 0.300s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:17 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a 1073741824 Sep 11 14:09:17 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-61d4d3fc-589c-46c2-97c2-b758f669de36" released by "delete_volume" :: held 0.746s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Created reservations ['0784d2a8-3dde-4ff5-a7cc-92b74300d461', '12844963-4c76-4d72-9c85-d86b340e30ef', 'd96ee19e-0e8b-479a-8316-0f2a33f8cc7b', 'b7e54e39-8f1c-46b0-a9c8-33859e54e8ba'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:17 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:17 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:17 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.257s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-5f5440c8-9a2c-47db-b096-1a0352ddc382 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-61d4d3fc-589c-46c2-97c2-b758f669de36-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:17 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a 1073741824" returned: 0 in 0.463s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:17 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a Sep 11 14:09:17 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:17 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a" returned: 0 in 0.263s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f8daed-ee0f-4769-b82f-214a26b62b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78297ced-bdd8-4ee9-9287-802551463a7a', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6347206-9bf4-4825-a0c3-f378f0b2f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:17 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Volume volume-78297ced-bdd8-4ee9-9287-802551463a7a (78297ced-bdd8-4ee9-9287-802551463a7a): created successfully Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6347206-9bf4-4825-a0c3-f378f0b2f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Flow 'volume_create_manager' (0c84102b-0f7b-483c-9e25-f7636a9ce647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:17 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-c384b0f1-a967-4dbc-ba0a-f5d3c85c68b1 tempest-ProjectReaderTests-769221937 None] Created volume successfully. Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (fbc40789-0128-441b-9f69-04ee7febc602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:17 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe2e6a4-1d36-47ac-bb72-df70ae30c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe2e6a4-1d36-47ac-bb72-df70ae30c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623481100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b689eaeb-03d3-4865-9980-b0ffb511fb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:18Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b399603-4927-4e7b-8a5e-d356683f33c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b399603-4927-4e7b-8a5e-d356683f33c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4615f9a3-2040-451c-b4c8-8dbe123deaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4615f9a3-2040-451c-b4c8-8dbe123deaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b689eaeb-03d3-4865-9980-b0ffb511fb67', 'volume_name': 'volume-b689eaeb-03d3-4865-9980-b0ffb511fb67', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2b89f0-17fe-451b-a636-462ed8e57181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2b89f0-17fe-451b-a636-462ed8e57181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032ce1a2-8543-41eb-a923-1e26eb9a24ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:18 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Volume b689eaeb-03d3-4865-9980-b0ffb511fb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b689eaeb-03d3-4865-9980-b0ffb511fb67', 'volume_size': 1} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623481100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b689eaeb-03d3-4865-9980-b0ffb511fb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:18Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Creating volume b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:18 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-78297ced-bdd8-4ee9-9287-802551463a7a-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:18 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 1073741824 Sep 11 14:09:18 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Lock "cinder-78297ced-bdd8-4ee9-9287-802551463a7a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Acquiring lock "cinder-quobyte-78297ced-bdd8-4ee9-9287-802551463a7a" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-78297ced-bdd8-4ee9-9287-802551463a7a" acquired by "delete_volume" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a9a9cf-b92a-44be-9793-550b21d170e3]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:18 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a Sep 11 14:09:18 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:18 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 1073741824" returned: 0 in 0.432s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:18 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a" returned: 0 in 0.372s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:18 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 Sep 11 14:09:18 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:18 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a Sep 11 14:09:18 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:18 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032ce1a2-8543-41eb-a923-1e26eb9a24ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b689eaeb-03d3-4865-9980-b0ffb511fb67', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0285b4-b702-4fa3-8c15-de410b544d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:18 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-78297ced-bdd8-4ee9-9287-802551463a7a" returned: 0 in 0.253s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:18 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Volume volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 (b689eaeb-03d3-4865-9980-b0ffb511fb67): created successfully Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0285b4-b702-4fa3-8c15-de410b544d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (fbc40789-0128-441b-9f69-04ee7febc602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Lock "cinder-quobyte-78297ced-bdd8-4ee9-9287-802551463a7a" released by "delete_volume" :: held 0.674s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:18 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-721b50c2-4520-4323-b808-5dbb11725094 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Created reservations ['4e754149-a2ce-4e27-9371-1a3fecc552a0', 'd5159ede-0cbd-4e51-ba68-895cf34c6ed5', 'a70f31a7-a406-49aa-ae2e-e78c9d044d56', 'e0b83a4b-4a87-400a-a15b-b098b81f03c2'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:18 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:18 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:18 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot b924789a-90c9-4a1a-8cea-146c26c5a9d5 of volume b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[13152d7e-0f5c-441b-a2e8-a1bdf0634e10]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:19 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.278s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:19 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Deleted volume successfully. Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-f5d8202a-9538-4fec-9462-cfb5fab8998d tempest-ProjectReaderTests-769221937 None] Lock "cinder-78297ced-bdd8-4ee9-9287-802551463a7a-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:19 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 Sep 11 14:09:19 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:19 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67" returned: 0 in 0.382s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:19 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 1G Sep 11 14:09:19 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:19 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 1G" returned: 0 in 0.436s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:19 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:20 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 Sep 11 14:09:20 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:20 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5" returned: 0 in 0.319s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:20 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 is being set with open permissions: ugo+rw Sep 11 14:09:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:20 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 Sep 11 14:09:20 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:20 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5" returned: 0 in 0.241s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:20 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info Sep 11 14:09:20 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:20 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info" returned: 0 in 0.269s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:20 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info is being set with open permissions: ugo+rw Sep 11 14:09:20 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:20 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info Sep 11 14:09:20 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:21 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.info" returned: 0 in 0.243s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:21 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-f8880f87-051c-48a6-9378-cdac883c0c07 tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-b924789a-90c9-4a1a-8cea-146c26c5a9d5-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-b924789a-90c9-4a1a-8cea-146c26c5a9d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-b689eaeb-03d3-4865-9980-b0ffb511fb67" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-b689eaeb-03d3-4865-9980-b0ffb511fb67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-b924789a-90c9-4a1a-8cea-146c26c5a9d5" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-b924789a-90c9-4a1a-8cea-146c26c5a9d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot b924789a-90c9-4a1a-8cea-146c26c5a9d5 of volume b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cfd80d-f129-4b5b-92e8-75c676553a15]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:21 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 Sep 11 14:09:21 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:21 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5" returned: 0 in 0.344s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b689eaeb-03d3-4865-9980-b0ffb511fb67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c1058-66d4-49d9-87dd-d6b01a71caef]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:21 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:21 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 Sep 11 14:09:21 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:22 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67" returned: 0 in 0.336s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:22 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 Sep 11 14:09:22 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:22 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5" returned: 0 in 0.329s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:22 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5 Sep 11 14:09:22 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:22 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67.b924789a-90c9-4a1a-8cea-146c26c5a9d5" returned: 0 in 0.231s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-b924789a-90c9-4a1a-8cea-146c26c5a9d5" released by "_delete_snapshot" :: held 1.326s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-b689eaeb-03d3-4865-9980-b0ffb511fb67" released by "delete_snapshot" :: held 1.348s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Created reservations ['2def263b-a984-4410-82f3-26c04764bee5', 'a3cb6243-1296-4900-969d-f6d723c5212a', '402a948e-8391-46f4-a250-aaa8a78416d0', '8a956f97-2df9-48d7-b516-48c65791cb2c'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:22 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:09:22 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-62ef98bc-4939-4b0e-8dd5-71135556b560 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-b924789a-90c9-4a1a-8cea-146c26c5a9d5-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-b689eaeb-03d3-4865-9980-b0ffb511fb67-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-b689eaeb-03d3-4865-9980-b0ffb511fb67-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-b689eaeb-03d3-4865-9980-b0ffb511fb67" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-b689eaeb-03d3-4865-9980-b0ffb511fb67" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[084e9765-4cae-41a8-aa01-27a2013a4503]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:23 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 Sep 11 14:09:23 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:23 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67" returned: 0 in 0.351s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:23 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:23 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67 Sep 11 14:09:23 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:24 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-b689eaeb-03d3-4865-9980-b0ffb511fb67" returned: 0 in 0.254s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-b689eaeb-03d3-4865-9980-b0ffb511fb67" released by "delete_volume" :: held 0.663s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Created reservations ['41241491-ec24-436c-8a4b-5daf07bf9db5', '1fc166a5-66ef-4856-86af-9ed7c7f8216b', '9da3cf01-4a5d-41bd-80dc-cf06e5b490c7', '8f9ad3a6-9565-4c29-9793-dc72bb21a5e3'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:24 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:24 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:24 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:24 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-a95248a5-d9e8-447e-89c2-ad91b0f67564 tempest-ProjectMemberTests-1521204887 None] Lock "cinder-b689eaeb-03d3-4865-9980-b0ffb511fb67-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:24 devstack cinder-volume[88731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (c54f698d-a5dd-49b2-94c6-00adaf72fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6851222a-e33c-4d22-8a66-e046a50abdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6851222a-e33c-4d22-8a66-e046a50abdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434842246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4877b4-f16a-46a8-a68f-241d7a3cb96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:25Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b290abfd-936a-4a37-97ee-122827482e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b290abfd-936a-4a37-97ee-122827482e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d208a604-d0c7-46b5-abb0-6a400b15b92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d208a604-d0c7-46b5-abb0-6a400b15b92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f4877b4-f16a-46a8-a68f-241d7a3cb96c', 'volume_name': 'volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188794b7-219e-4c6b-a5b6-d1e14fe1b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188794b7-219e-4c6b-a5b6-d1e14fe1b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbde645-18a9-423e-b836-3d2783c814ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Volume 0f4877b4-f16a-46a8-a68f-241d7a3cb96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c', 'volume_size': 1} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T12:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434842246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4877b4-f16a-46a8-a68f-241d7a3cb96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752cf4a95dd34ddeb57f1ffddd6a26e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T12:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T12:09:25Z,use_quota=True,user_id='f27f9e15748f4605a8b982615815d5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9481773-185b-4a5b-9d64-91e675469531),volume_type_id=e9481773-185b-4a5b-9d64-91e675469531)}" {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Creating volume 0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Selected osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af as target Quobyte volume. {{(pid=88731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 14:09:25 devstack cinder-volume[88731]: INFO cinder.volume.drivers.remotefs [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] casted to osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c 1073741824 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:25 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c 1073741824 Sep 11 14:09:25 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:25 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c 1073741824" returned: 0 in 0.394s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:25 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c Sep 11 14:09:25 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:25 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" returned: 0 in 0.255s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'} {{(pid=88731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbde645-18a9-423e-b836-3d2783c814ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c', 'volume_size': 1}' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7af3d51-5406-472f-8e60-2438b9d37678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 14:09:25 devstack cinder-volume[88731]: INFO cinder.volume.flows.manager.create_volume [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Volume volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c (0f4877b4-f16a-46a8-a68f-241d7a3cb96c): created successfully Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7af3d51-5406-472f-8e60-2438b9d37678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 14:09:25 devstack cinder-volume[88731]: DEBUG cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Flow 'volume_create_manager' (c54f698d-a5dd-49b2-94c6-00adaf72fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 14:09:25 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-b5802a02-25af-48a9-81fc-f8ac28a2f872 tempest-ProjectMemberTests-1521204887 None] Created volume successfully. Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Creating offline snapshot c23d85b7-1a5b-427e-923d-86cfe9318b22 of volume 0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f3647-d65b-406b-801a-f5978f0a504d]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:26 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c Sep 11 14:09:26 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:26 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 1G {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:26 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 1G Sep 11 14:09:26 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:26 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 1G" returned: 0 in 0.384s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:26 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:26 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 Sep 11 14:09:26 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:27 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c -F qcow2 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22" returned: 0 in 0.286s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:27 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 is being set with open permissions: ugo+rw Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:27 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 Sep 11 14:09:27 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:27 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22" returned: 0 in 0.237s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:27 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info Sep 11 14:09:27 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:27 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info" returned: 0 in 0.245s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:27 devstack cinder-volume[88731]: WARNING cinder.volume.drivers.remotefs [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info is being set with open permissions: ugo+rw Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:27 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info Sep 11 14:09:27 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:27 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.info" returned: 0 in 0.240s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:27 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:27 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-49e6ce35-29df-4acd-ad26-45fa2e456f5d tempest-ProjectMemberTests-1521204887 None] Create snapshot completed successfully Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-c23d85b7-1a5b-427e-923d-86cfe9318b22-delete_snapshot" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c23d85b7-1a5b-427e-923d-86cfe9318b22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" by "delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-c23d85b7-1a5b-427e-923d-86cfe9318b22" by "_delete_snapshot" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c23d85b7-1a5b-427e-923d-86cfe9318b22" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Deleting offline snapshot c23d85b7-1a5b-427e-923d-86cfe9318b22 of volume 0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] snapshot_file for this snap is: volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 {{(pid=88731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c8580e-4663-4f39-b1ff-cdbfc241ea3e]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:28 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 Sep 11 14:09:28 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:28 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22" returned: 0 in 0.367s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.remotefs [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b95b03-9b9d-4f1f-b57d-a590e8895344]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:28 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:28 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c Sep 11 14:09:28 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:29 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" returned: 0 in 0.355s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:29 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 Sep 11 14:09:29 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:29 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22" returned: 0 in 0.321s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:29 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22 Sep 11 14:09:29 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:29 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c.c23d85b7-1a5b-427e-923d-86cfe9318b22" returned: 0 in 0.246s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-c23d85b7-1a5b-427e-923d-86cfe9318b22" released by "_delete_snapshot" :: held 1.369s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" released by "delete_snapshot" :: held 1.390s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Created reservations ['982deb13-45b8-46bc-a6af-e1453fe637ef', 'cc8834a3-32a2-48d0-a075-5dc01264c08a', 'd8a9774e-cb58-454b-b177-c1e7792d21f3', '6cb0fcff-3021-4499-9bb5-5ff7dd03f948'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:29 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Delete snapshot completed successfully. Sep 11 14:09:29 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-eb2cde30-353c-4c8d-96bc-65f9da0d70fc tempest-ProjectMemberTests-1521204887 None] Lock "cinder-c23d85b7-1a5b-427e-923d-86cfe9318b22-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-0f4877b4-f16a-46a8-a68f-241d7a3cb96c-delete_volume" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Lock "cinder-0f4877b4-f16a-46a8-a68f-241d7a3cb96c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Acquiring lock "cinder-quobyte-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" by "delete_volume" {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" acquired by "delete_volume" :: waited 0.020s {{(pid=88731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a817c-bdbb-4159-a7bf-aa55f21ef80b]: (4, 'qcow2') {{(pid=89760) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:30 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c Sep 11 14:09:30 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:30 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" returned: 0 in 0.349s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:30 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:30 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c Sep 11 14:09:30 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:31 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad/volume-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" returned: 0 in 0.242s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Lock "cinder-quobyte-0f4877b4-f16a-46a8-a68f-241d7a3cb96c" released by "delete_volume" :: held 0.643s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG cinder.quota [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Created reservations ['21074a90-e69c-4d73-b7a5-5a2edb4863cb', 'c3d77a89-35bd-46d3-aced-b0e9ca3f1cac', '11c24154-5c92-4b63-9876-62932b3edf0e', '9b5fd103-4a7c-4edd-a8db-66fbccf05e31'] {{(pid=88731) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af': None} {{(pid=88731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG cinder.volume.drivers.quobyte [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8406c177-1cbe-48f6-b661-8ebf0d27b6af'] {{(pid=88731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.lockutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 14:09:31 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad Sep 11 14:09:31 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 14:09:31 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG oslo_concurrency.processutils [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/89513d0f0a16fff092e3ecb7e86002ad" returned: 0 in 0.238s {{(pid=88731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG cinder.manager [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Notifying Schedulers of capabilities ... {{(pid=88731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 14:09:31 devstack cinder-volume[88731]: INFO cinder.volume.manager [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Deleted volume successfully. Sep 11 14:09:31 devstack cinder-volume[88731]: DEBUG cinder.coordination [None req-29e3efe7-c729-4f0e-9ba3-7a6f6e1012fa tempest-ProjectMemberTests-1521204887 None] Lock "cinder-0f4877b4-f16a-46a8-a68f-241d7a3cb96c-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 14:09:41 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=85,cinder:UPDATE=106,cinder:DELETE=10,cinder:INSERT=30 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 14:09:41 devstack cinder-volume[88731]: DEBUG dbcounter [-] [88731] Writing DB stats cinder:SELECT=80,cinder:UPDATE=120,cinder:INSERT=29,cinder:DELETE=9 {{(pid=88731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}